00000001:02000400:1.0F:1787381213.852431:0:2963:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1787381231.540332:0:3184:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1787381233.111384:0:3244:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 855 MB/s 00000001:01000000:1.0:1787381233.363846:0:3244:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 781 MB/s 00000001:01000000:1.0:1787381233.613160:0:3244:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4675 MB/s 00000020:02000000:2.0:1787381234.505717:0:3277:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_115_ge5824fa 00000400:02000000:3.0:1787381235.548511:0:3292:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.203.122@tcp [8/256/0/180] 00008000:02000000:3.0:1787381239.399605:0:3441:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1787381287.548544:0:5241:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787381295.893185:0:5771:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787381295.893191:0:5771:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1787381295.894509:0:5771:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000d5ebaa59 00000080:02000400:3.0:1787381295.894523:0:5771:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1787381295.901836:0:5771:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1787381295.901849:0:5771:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787381295.901887:0:5771:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000008e6b5085) 00000020:00000080:3.0:1787381295.901908:0:5771:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0F:1787381295.957771:0:5771:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1787381295.958182:0:5771:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1787381295.991501:0:5771:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1787381295.991611:0:5771:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787381295.991634:0:5771:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1787381295.991676:0:5771:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787381295.991696:0:5771:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1787381295.992260:0:5771:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1787381295.992268:0:5771:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787381295.992277:0:5771:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbdc38ada7ea0f613 00000020:01000004:0.0:1787381295.992283:0:5771:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1787381295.992288:0:5771:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1787381295.992292:0:5771:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d5ebaa59 from MGS 00000020:01000004:0.0:1787381295.992296:0:5771:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1787381295.992427:0:5771:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000219eac1d) 00000020:00000080:0.0:1787381295.992440:0:5771:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1787381295.992499:0:5771:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d5ebaa59 from MGS, refs=2 00080000:01000000:0.0:1787381295.992504:0:5771:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787381295.992509:0:5771:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbdc38ada7ea0f621 00000100:00100000:0.0:1787381295.992801:0:5771:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1787381295.992972:0:5771:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1787381295.992978:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1787381295.994450:0:5771:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787381295.994461:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787381295.995862:0:5771:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787381295.997223:0:5771:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787381295.997231:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787381295.999355:0:5771:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787381295.999382:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787381296.000080:0:5771:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787381296.000088:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787381296.001151:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381296.001155:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381296.001157:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381296.001462:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381296.001465:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381296.001466:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381296.001995:0:5771:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787381296.006429:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1787381296.251055:0:5771:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2359 MB/s 00000001:01000000:0.0:1787381296.501411:0:5771:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3539 MB/s 00000001:01000000:2.0:1787381296.751242:0:5771:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 511 MB/s 00000001:01000000:0.0:1787381297.001305:0:5771:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 503 MB/s 00080000:10000000:0.0:1787381297.017001:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:0.0:1787381297.031330:0:5771:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1787381297.031347:0:5771:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787381297.031350:0:5771:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787381297.034750:0:5781:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1787381297.034827:0:5771:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1787381297.034887:0:5771:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1787381297.035182:0:5771:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787381297.035214:0:5771:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787381297.035544:0:5771:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787381297.035667:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787381297.035672:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00010000:00010000:3.0:1787381297.046216:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787381297.046606:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787381297.046626:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787381297.047176:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787381297.047183:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787381297.048944:0:5771:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787381297.048967:0:5771:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.122@tcp' 00000020:01000004:0.0:1787381297.048969:0:5771:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787381297.049050:0:5771:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.122@tcp (typ=mgc) 00000020:00000080:0.0:1787381297.049062:0:5771:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.122@tcp (00000000e5c26beb) 00000020:00000080:0.0:1787381297.049077:0:5771:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787381297.049147:0:5771:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000cc73ff47@MGC192.168.203.122@tcp: add connection 192.168.203.122@tcp at head 00010000:00010000:0.0:1787381297.049321:0:5771:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.122@tcp-0 is initialized 00000040:01000000:0.0:1787381297.049328:0:5771:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.122@tcp ctxt 1 is initialized 00000100:00080000:3.0:1787381297.050254:0:5786:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1787381297.050494:0:5787:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787381297.050557:0:5771:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.122@tcp (uuid cd19486c-5291-4823-bb9c-f3a73416a496) 00000020:00000080:0.0:1787381297.050575:0:5771:0:(genops.c:1406:class_connect()) connect: client cd19486c-5291-4823-bb9c-f3a73416a496, cookie 0xbdc38ada7ea0f62f 00000100:00080000:0.0:1787381297.050585:0:5771:0:(import.c:510:import_select_connection()) MGC192.168.203.122@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787381297.050590:0:5771:0:(import.c:624:import_select_connection()) MGC192.168.203.122@tcp: import 00000000cc73ff47 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:0.0:1787381297.050628:0:5771:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007b659cce x1874205065871488/t0(0) o250->MGC192.168.203.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787381297.050647:0:5771:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import cd19486c-5291-4823-bb9c-f3a73416a496->MGS 00000020:01000004:0.0:1787381297.050673:0:5771:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1787381297.050678:0:5771:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1787381297.050688:0:5771:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000b62870a9) 00000020:00000080:0.0:1787381297.050698:0:5771:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787381297.052311:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007b659cce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cd19486c-5291-4823-bb9c-f3a73416a496:3307:1874205065871488:0@lo:250: 00000100:00100000:3.0:1787381297.052433:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381297.052521:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065871488 00000100:00100000:3.0:1787381297.052528:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065871488 00000100:00100000:3.0:1787381297.052559:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787381297.052566:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000078be592d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3307:x1874205065871488:12345-0@lo:250: 00010000:00080000:3.0:1787381297.052593:0:5783:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from cd19486c-5291-4823-bb9c-f3a73416a496@0@lo t0 exp 0000000000000000 cur 155 last 0 00000020:00000080:3.0:1787381297.052629:0:5783:0:(genops.c:1406:class_connect()) connect: client cd19486c-5291-4823-bb9c-f3a73416a496, cookie 0xbdc38ada7ea0f63d 00000100:00080000:3.0:1787381297.052749:0:5783:0:(import.c:65:import_set_state_nolock()) 00000000b0cdc20a : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787381297.052812:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000078be592d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+5:3307:x1874205065871488:12345-0@lo:250: Request processed in 245us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381297.052821:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787381297.052863:0:3307:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.122@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787381297.052870:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.122@tcp: connect to target with instance 0 00000100:00080000:3.0:1787381297.052876:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.122@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787381297.052880:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787381297.052882:0:3307:0:(import.c:65:import_set_state_nolock()) 00000000cc73ff47 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787381297.052885:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787381297.052902:0:3307:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787381297.052907:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007b659cce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cd19486c-5291-4823-bb9c-f3a73416a496:3307:1874205065871488:0@lo:250: 00000100:00100000:3.0:1787381297.073922:0:5771:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787381297.074271:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787381297.074278:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787381297.075428:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787381297.075438:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787381297.075991:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787381297.075998:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787381297.076780:0:5771:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787381297.077123:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787381297.077129:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787381297.079541:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787381297.079554:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787381297.121452:0:5771:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787381297.121662:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787381297.121668:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787381297.122731:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787381297.122740:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787381297.123572:0:5771:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787381297.123717:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787381297.123722:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787381297.124307:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787381297.124314:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787381297.124933:0:5771:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787381297.125123:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787381297.125128:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787381297.125962:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787381297.125969:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787381297.126883:0:5771:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787381297.127164:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787381297.127171:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787381297.127583:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787381297.127590:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787381297.154406:0:5771:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787381297.154605:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787381297.154612:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787381297.156705:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787381297.156721:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787381297.158307:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787381297.158319:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787381297.159421:0:5771:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787381297.159447:0:5771:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1787381297.159453:0:5771:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.122@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787381297.159925:0:5771:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.122@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787381297.159961:0:5771:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.122@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1787381297.159965:0:5771:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787381297.159966:0:5771:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787381297.159967:0:5771:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787381297.159968:0:5771:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787381297.159969:0:5771:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787381297.159970:0:5771:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787381297.159971:0:5771:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787381297.159972:0:5771:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787381297.159974:0:5771:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787381297.159975:0:5771:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787381297.159976:0:5771:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787381297.159977:0:5771:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787381297.159979:0:5771:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1787381297.159986:0:5771:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787381297.159987:0:5771:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787381297.159988:0:5771:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787381297.159988:0:5771:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787381297.159989:0:5771:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787381297.159990:0:5771:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787381297.159991:0:5771:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787381297.159992:0:5771:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787381297.159992:0:5771:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787381297.159993:0:5771:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787381297.159994:0:5771:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787381297.159994:0:5771:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787381297.160200:0:5771:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787381297.160219:0:5771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000009816f8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:5771:1874205065871616:0@lo:253: 00000100:00100000:1.0:1787381297.160308:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381297.160406:0:5771:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f5e37b11 going to sleep for 11 seconds 00000100:00100000:3.0:1787381297.160458:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065871616 00000100:00100000:3.0:1787381297.160466:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065871616 00000100:00100000:3.0:1787381297.160508:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787381297.160516:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000390d92df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+5:5771:x1874205065871616:12345-0@lo:253: 20000000:01000000:3.0:1787381297.160579:0:5785:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787381297.160582:0:5785:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1787381297.161060:0:5806:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787381297.161121:0:5785:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1787381297.161459:0:5785:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787381297.162716:0:5807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1787381297.163248:0:5785:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787381297.163253:0:5785:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1787381297.163259:0:5785:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1787381297.163262:0:5785:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1787381297.163277:0:5785:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1787381297.163506:0:5785:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787381297.163708:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1787381297.163720:0:5785:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787381297.164377:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1787381297.164442:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1787381297.164478:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1787381297.164569:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1787381297.164577:0:5785:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1787381297.164619:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1787381297.164626:0:5785:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1787381297.164655:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1787381297.164661:0:5785:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1787381297.164687:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1787381297.164731:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1787381297.165324:0:5785:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787381297.165333:0:5785:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1787381297.165356:0:5785:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787381297.165579:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1787381297.165592:0:5785:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787381297.165633:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1787381297.165669:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1787381297.165734:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1787381297.165747:0:5785:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1787381297.165966:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1787381297.165975:0:5785:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787381297.166191:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1787381297.166232:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1787381297.166467:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1787381297.166481:0:5785:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1787381297.166585:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1787381297.166594:0:5785:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1787381297.166629:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1787381297.166664:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1787381297.166961:0:5785:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1787381297.167232:0:5785:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1787381297.167240:0:5785:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1787381297.167664:0:5808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1787381297.168216:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1787381297.168239:0:5785:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.122@tcp for mdt 20000000:01000000:3.0:1787381297.168242:0:5785:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.122@tcp (null) (null) (null) 00000040:00080000:3.0:1787381297.168279:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1787381297.168287:0:5785:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787381297.168317:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1787381297.168324:0:5785:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.122@tcp (null) (null) 00000040:00080000:3.0:1787381297.168382:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1787381297.168392:0:5785:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1787381297.168425:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1787381297.168467:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1787381297.168528:0:5785:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787381297.168531:0:5785:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787381297.168536:0:5785:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1787381297.168542:0:5785:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1787381297.168984:0:5809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:2.0:1787381297.169136:0:5785:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1787381297.178777:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1787381297.179000:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:2.0:1787381297.179211:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:2.0:1787381297.179231:0:5785:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787381297.179234:0:5785:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787381297.179237:0:5785:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787381297.179278:0:5785:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787381297.179281:0:5785:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787381297.179312:0:5785:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787381297.179314:0:5785:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787381297.180250:0:5810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1787381297.180570:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1787381297.180613:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1787381297.180912:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:2.0:1787381297.180927:0:5785:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787381297.180929:0:5785:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787381297.181836:0:5811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:2.0:1787381297.182231:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:2.0:1787381297.182293:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:2.0:1787381297.182370:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:2.0:1787381297.182392:0:5785:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787381297.182395:0:5785:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:2.0:1787381297.182401:0:5785:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787381297.182423:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001c24d3ce/0xbdc38ada7ea0f644 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381297.182439:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001c24d3ce/0xbdc38ada7ea0f644 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381297.182449:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001c24d3ce/0xbdc38ada7ea0f644 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381297.182454:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001c24d3ce/0xbdc38ada7ea0f644 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381297.182460:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001c24d3ce/0xbdc38ada7ea0f644 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381297.182465:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001c24d3ce/0xbdc38ada7ea0f644 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381297.182470:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001c24d3ce already unused, calling callback (000000009b9c7422) 00010000:00010000:2.0:1787381297.182474:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001c24d3ce/0xbdc38ada7ea0f644 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381297.182480:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001c24d3ce/0xbdc38ada7ea0f644 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381297.182491:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001c24d3ce/0xbdc38ada7ea0f644 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381297.182496:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001c24d3ce/0xbdc38ada7ea0f644 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381297.182511:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001c24d3ce/0xbdc38ada7ea0f644 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787381297.182543:0:5785:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787381297.442540:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000390d92df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+5:5771:x1874205065871616:12345-0@lo:253: Request processed in 282018us (282226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381297.442561:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787381297.442702:0:5771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000009816f8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:5771:1874205065871616:0@lo:253: 10000000:01000000:1.0:1787381297.442716:0:5771:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787381297.442718:0:5771:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787381297.442720:0:5771:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787381297.442722:0:5771:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787381297.442723:0:5771:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1787381297.442724:0:5771:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787381297.442726:0:5771:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787381297.442727:0:5771:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787381297.442728:0:5771:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787381297.442730:0:5771:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787381297.442731:0:5771:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787381297.442732:0:5771:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787381297.442749:0:5771:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d5ebaa59 from lustre-MDT0000 10000000:01000000:1.0:1787381297.442840:0:5771:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787381297.442844:0:5771:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787381297.442848:0:5771:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a1646130000 10000000:01000000:1.0:1787381297.442863:0:5771:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787381297.442870:0:5771:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9a1646130000 from 1 10000000:01000000:1.0:1787381297.442873:0:5771:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787381297.442903:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 00000000ca8f57b0/0xbdc38ada7ea0f64b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381297.442914:0:5771:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 00000000ca8f57b0/0xbdc38ada7ea0f64b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381297.442922:0:5771:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 00000000ca8f57b0/0xbdc38ada7ea0f64b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381297.442937:0:5771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000009816f8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:5771:1874205065871744:0@lo:101: 00000100:00100000:1.0:1787381297.442979:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381297.443287:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065871744 00000100:00100000:3.0:1787381297.443294:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065871744 00000100:00100000:3.0:1787381297.443329:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787381297.443336:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a48d6b56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+5:5771:x1874205065871744:12345-0@lo:101: 00010000:00010000:3.0:1787381297.443348:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381297.443372:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000017132205/0xbdc38ada7ea0f652 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0f64b expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381297.443394:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000017132205/0xbdc38ada7ea0f652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f64b expref: 6 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381297.443402:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000017132205/0xbdc38ada7ea0f652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f64b expref: 6 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381297.443410:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000017132205, rc 0) 00000100:00100000:3.0:1787381297.443438:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a48d6b56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+6:5771:x1874205065871744:12345-0@lo:101: Request processed in 103us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381297.443444:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787381297.443525:0:5771:0:(client.c:2702:ptlrpc_set_wait()) set 0000000045005d2e going to sleep for 11 seconds 00000100:00100000:1.0:1787381297.443541:0:5771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000009816f8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:5771:1874205065871744:0@lo:101: 00010000:00010000:1.0:1787381297.443552:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 00000000ca8f57b0/0xbdc38ada7ea0f64b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f652 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381297.443833:0:5771:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 00000000ca8f57b0/0xbdc38ada7ea0f64b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f652 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381297.443884:0:5771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000009816f8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:5771:1874205065871872:0@lo:501: 00000100:00100000:1.0:1787381297.443911:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381297.443937:0:5771:0:(client.c:2702:ptlrpc_set_wait()) set 0000000045005d2e going to sleep for 11 seconds 00000100:00100000:2.0:1787381297.444031:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065871872 00000100:00100000:2.0:1787381297.444036:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065871872 00000100:00100000:2.0:1787381297.444082:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787381297.444088:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005200661 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+6:5771:x1874205065871872:12345-0@lo:501: 00000100:00100000:2.0:1787381297.444295:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005200661 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+6:5771:x1874205065871872:12345-0@lo:501: Request processed in 207us (383us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787381297.444303:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787381297.444458:0:5771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000009816f8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:5771:1874205065871872:0@lo:501: 10000000:01000000:1.0:1787381297.444483:0:5771:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787381297.444501:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 00000000ca8f57b0/0xbdc38ada7ea0f64b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f652 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381297.444525:0:5771:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 00000000ca8f57b0/0xbdc38ada7ea0f64b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f652 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787381297.444532:0:5771:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a16659a7000 10000000:01000000:1.0:1787381297.444536:0:5771:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787381297.444540:0:5771:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a16659a7000 10000000:01000000:1.0:1787381297.444543:0:5771:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787381297.444545:0:5771:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9a16659a7000 from 1 10000000:01000000:1.0:1787381297.444547:0:5771:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787381297.444564:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 0000000026193fc6/0xbdc38ada7ea0f659 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381297.444570:0:5771:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 0000000026193fc6/0xbdc38ada7ea0f659 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381297.444576:0:5771:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 0000000026193fc6/0xbdc38ada7ea0f659 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381297.444587:0:5771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000009816f8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:5771:1874205065872000:0@lo:101: 00000100:00100000:1.0:1787381297.444612:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381297.444628:0:5771:0:(client.c:2702:ptlrpc_set_wait()) set 0000000045005d2e going to sleep for 11 seconds 00000100:00100000:3.0:1787381297.444738:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065872000 00000100:00100000:3.0:1787381297.444743:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065872000 00000100:00100000:3.0:1787381297.444832:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787381297.444839:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb50c1b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+6:5771:x1874205065872000:12345-0@lo:101: 00010000:00010000:3.0:1787381297.444847:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381297.444856:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005361204e/0xbdc38ada7ea0f660 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0f659 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381297.444870:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005361204e/0xbdc38ada7ea0f660 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f659 expref: 7 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381297.444878:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005361204e/0xbdc38ada7ea0f660 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f659 expref: 7 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381297.444891:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005361204e, rc 0) 00000100:00100000:3.0:1787381297.444926:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb50c1b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+7:5771:x1874205065872000:12345-0@lo:101: Request processed in 88us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381297.444932:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787381297.445130:0:5771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000009816f8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:5771:1874205065872000:0@lo:101: 00010000:00010000:1.0:1787381297.445140:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 0000000026193fc6/0xbdc38ada7ea0f659 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f660 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381297.445147:0:5771:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 0000000026193fc6/0xbdc38ada7ea0f659 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f660 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787381297.445169:0:5771:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787381297.445183:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 0000000026193fc6/0xbdc38ada7ea0f659 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f660 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381297.445189:0:5771:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 0000000026193fc6/0xbdc38ada7ea0f659 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f660 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787381297.445195:0:5771:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787381297.445198:0:5771:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787381297.445203:0:5771:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a16659a7000 10000000:01000000:1.0:1787381297.445206:0:5771:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787381297.445208:0:5771:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787381297.445210:0:5771:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787381297.445223:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 0000000028ddbdf4/0xbdc38ada7ea0f667 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381297.445230:0:5771:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 0000000028ddbdf4/0xbdc38ada7ea0f667 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381297.445236:0:5771:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 0000000028ddbdf4/0xbdc38ada7ea0f667 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381297.445247:0:5771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000009816f8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:5771:1874205065872128:0@lo:101: 00000100:00100000:1.0:1787381297.445270:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381297.445378:0:5771:0:(client.c:2702:ptlrpc_set_wait()) set 0000000045005d2e going to sleep for 11 seconds 00000100:00100000:3.0:1787381297.445500:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065872128 00000100:00100000:3.0:1787381297.445504:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065872128 00000100:00100000:3.0:1787381297.445622:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787381297.445630:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005cb73dc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+7:5771:x1874205065872128:12345-0@lo:101: 00010000:00010000:3.0:1787381297.445638:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381297.445646:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004562f7d5/0xbdc38ada7ea0f66e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0f667 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381297.445659:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004562f7d5/0xbdc38ada7ea0f66e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f667 expref: 8 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381297.445666:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004562f7d5/0xbdc38ada7ea0f66e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f667 expref: 8 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381297.445673:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004562f7d5, rc 0) 00000100:00100000:3.0:1787381297.445707:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005cb73dc8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+8:5771:x1874205065872128:12345-0@lo:101: Request processed in 78us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381297.445713:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787381297.445778:0:5771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000009816f8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:5771:1874205065872128:0@lo:101: 00010000:00010000:1.0:1787381297.445787:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 0000000028ddbdf4/0xbdc38ada7ea0f667 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f66e expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381297.445806:0:5771:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 0000000028ddbdf4/0xbdc38ada7ea0f667 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f66e expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381297.445845:0:5771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000009816f8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:5771:1874205065872256:0@lo:501: 00000100:00100000:1.0:1787381297.445867:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381297.445985:0:5771:0:(client.c:2702:ptlrpc_set_wait()) set 0000000045005d2e going to sleep for 11 seconds 00000100:00100000:0.0:1787381297.446141:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065872256 00000100:00100000:0.0:1787381297.446146:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065872256 00000100:00100000:0.0:1787381297.446166:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787381297.446170:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa696591 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+8:5771:x1874205065872256:12345-0@lo:501: 00000100:00100000:0.0:1787381297.446438:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa696591 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+9:5771:x1874205065872256:12345-0@lo:501: Request processed in 267us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381297.446446:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787381297.446622:0:5771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000009816f8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:5771:1874205065872256:0@lo:501: 00000100:00100000:1.0:1787381297.446652:0:5771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000009816f8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:5771:1874205065872384:0@lo:503: 00000100:00100000:1.0:1787381297.446688:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381297.446816:0:5771:0:(client.c:2702:ptlrpc_set_wait()) set 0000000045005d2e going to sleep for 11 seconds 00000100:00100000:0.0:1787381297.446854:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065872384 00000100:00100000:0.0:1787381297.446858:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065872384 00000100:00100000:0.0:1787381297.446920:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787381297.446926:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ced77f62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+9:5771:x1874205065872384:12345-0@lo:503: 00000100:00100000:0.0:1787381297.447158:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ced77f62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+9:5771:x1874205065872384:12345-0@lo:503: Request processed in 232us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381297.447165:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787381297.447233:0:5771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000009816f8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:5771:1874205065872384:0@lo:503: 00000100:00100000:1.0:1787381297.447870:0:5814:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000009816f8b pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:5814:1874205065872512:0@lo:502: 00000100:00100000:1.0:1787381297.447916:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381297.447984:0:5814:0:(client.c:2702:ptlrpc_set_wait()) set 000000009edc6344 going to sleep for 11 seconds 00000100:00100000:2.0:1787381297.448037:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065872512 00000100:00100000:2.0:1787381297.448119:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065872512 00000100:00100000:2.0:1787381297.448190:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787381297.448198:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e801fa4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+9:5814:x1874205065872512:12345-0@lo:502: 00000100:00100000:2.0:1787381297.448386:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e801fa4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+9:5814:x1874205065872512:12345-0@lo:502: Request processed in 188us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381297.448394:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787381297.448471:0:5814:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000009816f8b pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:5814:1874205065872512:0@lo:502: 00000020:01000000:1.0:1787381297.448494:0:5814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787381297.448505:0:5814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787381297.448507:0:5814:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787381297.448512:0:5814:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787381297.448526:0:5814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787381297.448544:0:5814:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000007c1d93cb) 00000020:00000080:1.0:1787381297.448562:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787381297.448569:0:5814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787381297.448689:0:5814:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787381297.448705:0:5814:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbdc38ada7ea0f67c 00000020:00000080:1.0:1787381297.448919:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787381297.448928:0:5814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787381297.448931:0:5814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787381297.448932:0:5814:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787381297.448934:0:5814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787381297.448938:0:5814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787381297.448939:0:5814:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787381297.448941:0:5814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787381297.448946:0:5814:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000001977f145) 00000020:00000080:1.0:1787381297.448956:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787381297.448959:0:5814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787381297.448960:0:5814:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787381297.448963:0:5814:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787381297.448968:0:5814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787381297.449030:0:5814:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d5ebaa59 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787381297.449168:0:5814:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000008d4773af) 00000020:00000080:1.0:1787381297.449179:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787381297.449244:0:5814:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787381297.449251:0:5814:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbdc38ada7ea0f691 00000020:00000080:1.0:1787381297.449345:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787381297.449352:0:5814:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787381297.449369:0:5814:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xbdc38ada7ea0f698 00080000:01000000:1.0:1787381297.449375:0:5814:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787381297.449378:0:5814:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbdc38ada7ea0f69f 00080000:10000000:1.0:1787381297.449821:0:5814:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1787381297.450136:0:5814:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1787381297.455162:0:5814:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787381297.530054:0:5814:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787381297.530492:0:5814:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787381297.533185:0:5814:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787381297.533494:0:5814:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787381297.580928:0:5814:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000cf330430) 00000020:00000080:2.0:1787381297.580950:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787381297.581933:0:5814:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787381297.581945:0:5814:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbdc38ada7ea0f6ad 00000020:00000080:1.0:1787381297.583222:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1787381297.589468:0:5814:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787381297.632950:0:5814:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787381297.691958:0:5814:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787381297.769620:0:5814:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787381297.802987:0:5814:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787381297.882922:0:5814:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1787381297.928747:0:5814:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xbdc38ada7ea0f6b4 00000020:00000080:2.0:1787381297.935217:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787381297.935231:0:5814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787381297.937444:0:5814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787381297.937452:0:5814:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787381297.937463:0:5814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787381297.937472:0:5814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787381297.937473:0:5814:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787381297.937478:0:5814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787381297.937567:0:5814:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787381297.937593:0:5814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787381297.937596:0:5814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787381297.937598:0:5814:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787381297.937600:0:5814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787381297.937603:0:5814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787381297.937604:0:5814:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787381297.937608:0:5814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787381297.937609:0:5814:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787381297.937660:0:5814:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002f6b2adc pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:5814:1874205065872640:0@lo:502: 00000100:00100000:2.0:1787381297.937736:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381297.937845:0:5814:0:(client.c:2702:ptlrpc_set_wait()) set 000000003d2d23fd going to sleep for 11 seconds 00000100:00100000:0.0:1787381297.937973:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065872640 00000100:00100000:0.0:1787381297.937982:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065872640 00000100:00100000:0.0:1787381297.938045:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787381297.938054:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008fc4b8bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+9:5814:x1874205065872640:12345-0@lo:502: 00000100:00100000:0.0:1787381297.938419:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008fc4b8bd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+9:5814:x1874205065872640:12345-0@lo:502: Request processed in 366us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381297.938427:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787381297.940235:0:5814:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002f6b2adc pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:5814:1874205065872640:0@lo:502: 00000020:01000000:1.0:1787381297.940280:0:5814:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787381297.940289:0:5814:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787381297.940292:0:5814:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787381297.940305:0:5814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1787381297.940470:0:5771:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1787381297.940490:0:5771:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787381297.940521:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 0000000028ddbdf4/0xbdc38ada7ea0f667 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f66e expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381297.940538:0:5771:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 0000000028ddbdf4/0xbdc38ada7ea0f667 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f66e expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787381297.940547:0:5771:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a16659a7000 from 1 10000000:01000000:3.0:1787381297.940550:0:5771:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787381297.940598:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 00000000433b8ef7/0xbdc38ada7ea0f6bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381297.940606:0:5771:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 00000000433b8ef7/0xbdc38ada7ea0f6bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381297.940614:0:5771:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 00000000433b8ef7/0xbdc38ada7ea0f6bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381297.940630:0:5771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ce6ac79c pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:5771:1874205065872768:0@lo:101: 00000100:00100000:3.0:1787381297.940680:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381297.940718:0:5771:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d1882417 going to sleep for 11 seconds 00000100:00100000:0.0:1787381297.940839:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065872768 00000100:00100000:0.0:1787381297.940845:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065872768 00000100:00100000:0.0:1787381297.940887:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787381297.940901:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000213c150a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+9:5771:x1874205065872768:12345-0@lo:101: 00010000:00010000:0.0:1787381297.940913:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381297.940924:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000d762bd5/0xbdc38ada7ea0f6c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0f6bb expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381297.940945:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000d762bd5/0xbdc38ada7ea0f6c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f6bb expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381297.940954:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000d762bd5/0xbdc38ada7ea0f6c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f6bb expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381297.940963:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000d762bd5, rc 0) 00000100:00100000:0.0:1787381297.941032:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000213c150a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+10:5771:x1874205065872768:12345-0@lo:101: Request processed in 132us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381297.941039:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787381297.941151:0:5771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ce6ac79c pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:5771:1874205065872768:0@lo:101: 00010000:00010000:1.0:1787381297.941163:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 00000000433b8ef7/0xbdc38ada7ea0f6bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f6c2 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381297.941171:0:5771:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 00000000433b8ef7/0xbdc38ada7ea0f6bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f6c2 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381297.941725:0:5771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000009816f8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:5771:1874205065872896:0@lo:256: 00000100:00100000:1.0:1787381297.941762:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381297.941789:0:5771:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f2ea51da going to sleep for 11 seconds 00000100:00100000:1.0:1787381297.941810:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065872896 00000100:00100000:1.0:1787381297.941815:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065872896 00000100:00100000:1.0:1787381297.941841:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787381297.941846:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b40267c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+10:5771:x1874205065872896:12345-0@lo:256: 20000000:01000000:1.0:1787381297.941860:0:5785:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787381297.941865:0:5785:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787381297.941923:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b40267c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+10:5771:x1874205065872896:12345-0@lo:256: Request processed in 77us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381297.941930:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787381297.941964:0:5771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000009816f8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:5771:1874205065872896:0@lo:256: 10000000:01000000:1.0:1787381297.942537:0:5771:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787381297.942543:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 00000000433b8ef7/0xbdc38ada7ea0f6bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f6c2 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381297.942550:0:5771:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 00000000433b8ef7/0xbdc38ada7ea0f6bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f6c2 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787381297.942568:0:5771:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a16659a7000 from 1 10000000:01000000:1.0:1787381297.942570:0:5771:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787381297.942590:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 00000000be540742/0xbdc38ada7ea0f6c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381297.942596:0:5771:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 00000000be540742/0xbdc38ada7ea0f6c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381297.942602:0:5771:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 00000000be540742/0xbdc38ada7ea0f6c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381297.942612:0:5771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000009816f8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:5771:1874205065873024:0@lo:101: 00000100:00100000:1.0:1787381297.942639:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381297.942661:0:5771:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f2ea51da going to sleep for 11 seconds 00000100:00100000:1.0:1787381297.942677:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065873024 00000100:00100000:1.0:1787381297.942680:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065873024 00000100:00100000:1.0:1787381297.942705:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787381297.942710:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000271c55d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+10:5771:x1874205065873024:12345-0@lo:101: 00010000:00010000:1.0:1787381297.942718:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381297.942727:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000077764a1b/0xbdc38ada7ea0f6d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0f6c9 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381297.942742:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000077764a1b/0xbdc38ada7ea0f6d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f6c9 expref: 11 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381297.942749:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000077764a1b/0xbdc38ada7ea0f6d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f6c9 expref: 11 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381297.942756:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000077764a1b, rc 0) 00000100:00100000:1.0:1787381297.942790:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000271c55d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+11:5771:x1874205065873024:12345-0@lo:101: Request processed in 80us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381297.942796:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787381297.942828:0:5771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000009816f8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:5771:1874205065873024:0@lo:101: 00010000:00010000:1.0:1787381297.942837:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 00000000be540742/0xbdc38ada7ea0f6c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f6d0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381297.942844:0:5771:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 00000000be540742/0xbdc38ada7ea0f6c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f6d0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381297.942883:0:5771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000009816f8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:5771:1874205065873152:0@lo:501: 00000100:00100000:1.0:1787381297.942905:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381297.942915:0:5771:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f2ea51da going to sleep for 11 seconds 00000100:00100000:1.0:1787381297.942926:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065873152 00000100:00100000:1.0:1787381297.942929:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065873152 00000100:00100000:1.0:1787381297.942946:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787381297.942951:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003712e9f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+11:5771:x1874205065873152:12345-0@lo:501: 00000100:00100000:1.0:1787381297.943526:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003712e9f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+11:5771:x1874205065873152:12345-0@lo:501: Request processed in 574us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381297.943534:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787381297.943600:0:5771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000009816f8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:5771:1874205065873152:0@lo:501: 00000100:00100000:1.0:1787381297.943625:0:5771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000009816f8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:5771:1874205065873280:0@lo:503: 00000100:00100000:1.0:1787381297.943659:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381297.943677:0:5771:0:(client.c:2702:ptlrpc_set_wait()) set 00000000f2ea51da going to sleep for 11 seconds 00000100:00100000:1.0:1787381297.943688:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065873280 00000100:00100000:1.0:1787381297.943692:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065873280 00000100:00100000:1.0:1787381297.943711:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787381297.943721:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa0285b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+11:5771:x1874205065873280:12345-0@lo:503: 00000040:00080000:1.0:1787381297.943750:0:5785:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787381297.943783:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa0285b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+11:5771:x1874205065873280:12345-0@lo:503: Request processed in 62us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381297.943789:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787381297.943823:0:5771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000009816f8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:5771:1874205065873280:0@lo:503: 00000040:00080000:1.0:1787381297.947709:0:5819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1787381297.947851:0:5771:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1787381297.947873:0:5771:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787381297.947895:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 00000000be540742/0xbdc38ada7ea0f6c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f6d0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381297.947927:0:5771:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 00000000be540742/0xbdc38ada7ea0f6c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f6d0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787381297.947977:0:5771:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787381297.947980:0:5771:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a16659a7000 10000000:01000000:2.0:1787381297.947983:0:5771:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a16659a7000 10000000:01000000:2.0:1787381297.947987:0:5771:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787381297.947992:0:5771:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a16659a7000 from 1 10000000:01000000:2.0:1787381297.947994:0:5771:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787381297.948051:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 00000000880e8a0f/0xbdc38ada7ea0f6d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381297.948058:0:5771:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 00000000880e8a0f/0xbdc38ada7ea0f6d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381297.948068:0:5771:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 00000000880e8a0f/0xbdc38ada7ea0f6d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381297.948102:0:5771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000073844da9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:5771:1874205065873408:0@lo:101: 00000100:00100000:2.0:1787381297.948161:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381297.948201:0:5771:0:(client.c:2702:ptlrpc_set_wait()) set 000000007dfb22f2 going to sleep for 11 seconds 00000100:00100000:1.0:1787381297.948376:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065873408 00000100:00100000:1.0:1787381297.948384:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065873408 00000100:00100000:1.0:1787381297.948423:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787381297.948430:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051c6221f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+11:5771:x1874205065873408:12345-0@lo:101: 00010000:00010000:1.0:1787381297.948443:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381297.948454:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a99c7a2e/0xbdc38ada7ea0f6de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0f6d7 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381297.948476:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a99c7a2e/0xbdc38ada7ea0f6de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f6d7 expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381297.948486:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a99c7a2e/0xbdc38ada7ea0f6de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f6d7 expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381297.948494:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a99c7a2e, rc 0) 00000100:00100000:1.0:1787381297.948545:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051c6221f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+12:5771:x1874205065873408:12345-0@lo:101: Request processed in 114us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381297.948552:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787381297.948599:0:5771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000073844da9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:5771:1874205065873408:0@lo:101: 00010000:00010000:1.0:1787381297.948613:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 00000000880e8a0f/0xbdc38ada7ea0f6d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f6de expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381297.948628:0:5771:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 00000000880e8a0f/0xbdc38ada7ea0f6d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f6de expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381297.948673:0:5771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000009816f8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:5771:1874205065873536:0@lo:501: 00000100:00100000:1.0:1787381297.948698:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381297.948716:0:5771:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ee19f0c3 going to sleep for 11 seconds 00000100:00100000:3.0:1787381297.948984:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065873536 00000100:00100000:3.0:1787381297.948989:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065873536 00000100:00100000:3.0:1787381297.949043:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787381297.949050:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb66ea3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+12:5771:x1874205065873536:12345-0@lo:501: 00000100:00100000:3.0:1787381297.949305:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb66ea3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+12:5771:x1874205065873536:12345-0@lo:501: Request processed in 256us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381297.949313:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787381297.949547:0:5771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000009816f8b pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:5771:1874205065873536:0@lo:501: 00000100:00100000:0.0:1787381297.949580:0:5771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ff887596 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:5771:1874205065873664:0@lo:503: 00000100:00100000:0.0:1787381297.949619:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381297.949651:0:5771:0:(client.c:2702:ptlrpc_set_wait()) set 000000009827646c going to sleep for 11 seconds 00000100:00100000:3.0:1787381297.949788:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065873664 00000100:00100000:3.0:1787381297.949793:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065873664 00000100:00100000:3.0:1787381297.949823:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787381297.949828:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c68b7cd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+12:5771:x1874205065873664:12345-0@lo:503: 00000100:00100000:3.0:1787381297.950162:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c68b7cd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+12:5771:x1874205065873664:12345-0@lo:503: Request processed in 333us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381297.950169:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787381297.950610:0:5771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ff887596 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:5771:1874205065873664:0@lo:503: 00000100:00100000:2.0:1787381297.950942:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005a81befb pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:5820:1874205065873792:0@lo:502: 00000100:00100000:2.0:1787381297.950984:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381297.951043:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e8742948 going to sleep for 11 seconds 00000100:00100000:3.0:1787381297.951475:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065873792 00000100:00100000:3.0:1787381297.951481:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065873792 00000100:00100000:3.0:1787381297.951612:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787381297.951620:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dead33b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+12:5820:x1874205065873792:12345-0@lo:502: 00000100:00100000:3.0:1787381297.951865:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dead33b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+12:5820:x1874205065873792:12345-0@lo:502: Request processed in 245us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381297.951873:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787381297.951956:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005a81befb pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:5820:1874205065873792:0@lo:502: 00000020:01000004:1.0:1787381297.952040:0:5820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787381297.952053:0:5820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000003d12fea9) 00000020:00000080:1.0:1787381297.952072:0:5820:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1787381297.952250:0:5820:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d5ebaa59 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787381297.952254:0:5820:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000d5ebaa59 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787381297.952257:0:5820:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000d5ebaa59 4 00010000:00080000:1.0:1787381297.952290:0:5820:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006b7bc354@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.122@tcp at head 00010000:00010000:1.0:1787381297.953975:0:5820:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1787381297.954127:0:5820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787381297.954159:0:5820:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787381297.954171:0:5820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xbdc38ada7ea0f6ec 00000100:00080000:1.0:1787381297.954180:0:5820:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787381297.954184:0:5820:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000006b7bc354 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:1.0:1787381297.954213:0:5820:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008de4ee12 x1874205065873920/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787381297.954245:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008de4ee12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874205065873920:0@lo:38: 00000100:00100000:1.0:1787381297.954297:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381297.954364:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065873920 00000100:00100000:1.0:1787381297.954370:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065873920 00000100:00100000:1.0:1787381297.954403:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787381297.954409:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b9d04d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1874205065873920:12345-0@lo:38: 00000100:00100000:1.0:1787381297.954451:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b9d04d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1874205065873920:12345-0@lo:38: Request processed in 41us (153us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787381297.954458:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787381297.954486:0:3307:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787381297.954492:0:3307:0:(import.c:65:import_set_state_nolock()) 000000006b7bc354 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787381297.954503:0:3307:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787381297.954506:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008de4ee12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874205065873920:0@lo:38: 00000100:00080000:1.0:1787381297.954529:0:5820:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787381297.958968:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008de4ee12 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:5820:1874205065874048:0@lo:502: 00000100:00100000:1.0:1787381297.959242:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381297.959290:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c45468fa going to sleep for 11 seconds 00000100:00100000:3.0:1787381297.966055:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065874048 00000100:00100000:3.0:1787381297.966071:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065874048 00000100:00100000:3.0:1787381297.966144:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787381297.966152:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087f6f55e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+12:5820:x1874205065874048:12345-0@lo:502: 00000100:00100000:3.0:1787381297.966430:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087f6f55e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+12:5820:x1874205065874048:12345-0@lo:502: Request processed in 278us (7188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381297.966438:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787381297.970280:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008de4ee12 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:5820:1874205065874048:0@lo:502: 00000040:00080000:0.0:1787381297.970329:0:5820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1787381297.973067:0:5771:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1787381297.973232:0:5771:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787381297.973257:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 00000000880e8a0f/0xbdc38ada7ea0f6d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f6de expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381297.973269:0:5771:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 00000000880e8a0f/0xbdc38ada7ea0f6d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f6de expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787381297.973322:0:5771:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787381297.973324:0:5771:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787381297.973326:0:5771:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787381297.973327:0:5771:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787381297.973329:0:5771:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787381297.973330:0:5771:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787381297.973332:0:5771:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787381297.973333:0:5771:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787381297.973334:0:5771:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787381297.973341:0:5771:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787381297.973342:0:5771:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787381297.973343:0:5771:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787381297.973347:0:5771:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1787381297.973349:0:5771:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787381297.973350:0:5771:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787381297.973362:0:5771:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787381297.973364:0:5771:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787381297.973365:0:5771:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787381297.973366:0:5771:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787381297.973367:0:5771:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787381297.973367:0:5771:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787381297.973368:0:5771:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787381297.973369:0:5771:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787381297.973370:0:5771:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787381297.973370:0:5771:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787381297.973396:0:5771:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787381297.973413:0:5771:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000582f6d84 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:5771:1874205065874176:0@lo:253: 00000100:00100000:1.0:1787381297.973490:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381297.973610:0:5771:0:(client.c:2702:ptlrpc_set_wait()) set 00000000adcaa435 going to sleep for 11 seconds 00000100:00100000:0.0:1787381297.973791:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065874176 00000100:00100000:0.0:1787381297.973800:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065874176 00000100:00100000:0.0:1787381297.973862:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787381297.973871:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f2992c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+12:5771:x1874205065874176:12345-0@lo:253: 20000000:01000000:0.0:1787381297.973897:0:5783:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787381297.973916:0:5783:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787381298.055198:0:5783:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787381298.055224:0:5783:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787381298.055337:0:5806:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787381298.055342:0:5806:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787381298.055905:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000058c6e390/0xbdc38ada7ea0f6f3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381298.055924:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000d762bd5/0xbdc38ada7ea0f6c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f6bb expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381298.055932:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000058c6e390/0xbdc38ada7ea0f6f3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381298.055971:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000d762bd5/0xbdc38ada7ea0f6c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbdc38ada7ea0f6bb expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381298.056474:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000d762bd5/0xbdc38ada7ea0f6c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f6bb expref: 12 pid: 5783 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381298.056492:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ff887596 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5806:1874205065874304:0@lo:104: 00000100:00100000:0.0:1787381298.056953:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381298.057295:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065874304 00000100:00100000:3.0:1787381298.057304:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065874304 00000100:00100000:3.0:1787381298.057347:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787381298.057366:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055418fae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+3:5806:x1874205065874304:12345-0@lo:104: 00010000:00010000:3.0:1787381298.057379:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: 00000000433b8ef7/0xbdc38ada7ea0f6bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f6c2 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381298.057476:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set 000000004e7dc435 going to sleep for 11 seconds 00010000:00010000:3.0:1787381298.057542:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787381298.057548:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055418fae pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+3:5806:x1874205065874304:12345-0@lo:104: Request processed in 195us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381298.057568:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787381298.057700:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ff887596 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5806:1874205065874304:0@lo:104: 00010000:00010000:0.0:1787381298.057725:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000058c6e390/0xbdc38ada7ea0f6f3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381298.061417:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787381298.061428:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: 00000000433b8ef7/0xbdc38ada7ea0f6bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f6c2 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381298.061440:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000433b8ef7 already unused, calling callback (000000008ae671ec) 10000000:00010000:0.0:1787381298.061443:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: 00000000433b8ef7/0xbdc38ada7ea0f6bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbdc38ada7ea0f6c2 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381298.061469:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: 00000000433b8ef7/0xbdc38ada7ea0f6bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbdc38ada7ea0f6c2 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787381298.061475:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: 00000000433b8ef7/0xbdc38ada7ea0f6bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbdc38ada7ea0f6c2 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787381298.061481:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787381298.061663:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: 00000000433b8ef7/0xbdc38ada7ea0f6bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f6c2 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381298.061670:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787381298.061690:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: 00000000433b8ef7/0xbdc38ada7ea0f6bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f6c2 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381298.061696:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: 00000000433b8ef7/0xbdc38ada7ea0f6bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f6c2 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381298.061716:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381298.061718:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381298.061719:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787381298.061802:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ff887596 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd19486c-5291-4823-bb9c-f3a73416a496:3309:1874205065874432:0@lo:103: 00000100:00100000:0.0:1787381298.062091:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381298.062187:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065874432 00000100:00100000:0.0:1787381298.062194:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065874432 00010000:00010000:0.0:1787381298.062217:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000d762bd5/0xbdc38ada7ea0f6c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f6bb expref: 13 pid: 5783 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381298.062243:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787381298.062250:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f569b4a7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd19486c-5291-4823-bb9c-f3a73416a496+13:3309:x1874205065874432:12345-0@lo:103: 00010000:00010000:0.0:1787381298.062663:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787381298.062671:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000d762bd5/0xbdc38ada7ea0f6c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f6bb expref: 13 pid: 5783 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381298.062684:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000d762bd5/0xbdc38ada7ea0f6c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f6bb expref: 13 pid: 5783 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381298.062698:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000d762bd5/0xbdc38ada7ea0f6c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbdc38ada7ea0f6bb expref: 13 pid: 5783 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381298.062712:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000058c6e390/0xbdc38ada7ea0f6f3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381298.062719:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000058c6e390/0xbdc38ada7ea0f6f3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787381298.062734:0:5775:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007392683s 00010000:00010000:0.0:1787381298.062738:0:5775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000058c6e390/0xbdc38ada7ea0f6f3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381298.062743:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000058c6e390/0xbdc38ada7ea0f6f3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381298.062749:0:5775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000058c6e390/0xbdc38ada7ea0f6f3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381298.062753:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000058c6e390/0xbdc38ada7ea0f6f3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381298.062758:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000058c6e390 already unused, calling callback (000000009b9c7422) 00010000:00010000:0.0:1787381298.062761:0:5775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000058c6e390/0xbdc38ada7ea0f6f3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381298.062775:0:5775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000058c6e390/0xbdc38ada7ea0f6f3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381298.062801:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000058c6e390/0xbdc38ada7ea0f6f3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381298.062812:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787381298.063718:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f569b4a7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd19486c-5291-4823-bb9c-f3a73416a496+12:3309:x1874205065874432:12345-0@lo:103: Request processed in 1464us (1623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381298.063730:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787381298.063756:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ff887596 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd19486c-5291-4823-bb9c-f3a73416a496:3309:1874205065874432:0@lo:103: 00010000:00010000:0.0:1787381298.063773:0:5806:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000058c6e390/0xbdc38ada7ea0f6f3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381298.063791:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000058c6e390/0xbdc38ada7ea0f6f3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381298.063797:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000058c6e390/0xbdc38ada7ea0f6f3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381298.064701:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787381298.086282:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f2992c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+11:5771:x1874205065874176:12345-0@lo:253: Request processed in 112405us (112784us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381298.086298:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787381298.088913:0:5771:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000582f6d84 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:5771:1874205065874176:0@lo:253: 10000000:01000000:1.0:1787381298.088932:0:5771:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787381298.088935:0:5771:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787381298.088937:0:5771:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787381298.088938:0:5771:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787381298.088940:0:5771:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787381298.088941:0:5771:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787381298.088942:0:5771:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787381298.088943:0:5771:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787381298.088944:0:5771:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787381298.088946:0:5771:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787381298.088947:0:5771:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787381298.088948:0:5771:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787381298.088950:0:5771:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787381298.088966:0:5771:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787381298.106444:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1787381298.106922:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787381298.107347:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1787381298.107530:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787381298.107804:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1787381298.107999:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1787381298.108833:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1787381298.109204:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1787381298.109428:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1787381298.109584:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787381298.109864:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787381298.110228:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1787381298.173908:0:5771:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1787381298.207968:0:5771:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1787381298.208367:0:5825:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1787381298.208372:0:5825:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787381298.208523:0:5826:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787381298.212533:0:5771:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787381298.212698:0:5771:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787381298.213383:0:5771:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787381298.215807:0:5771:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787381298.216336:0:5771:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787381298.223317:0:5771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787381298.223856:0:5771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787381298.223886:0:5771:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1787381298.229890:0:5771:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1787381298.230501:0:5771:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1787381298.231840:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1787381298.231976:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1787381298.232160:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1787381298.232324:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1787381298.239132:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1787381298.239314:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1787381298.239468:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1787381298.239613:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1787381298.239787:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1787381298.240488:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1787381298.241674:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1787381298.241903:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1787381298.243363:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1787381298.243588:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1787381298.243774:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1787381298.244305:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1787381298.244643:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1787381298.244832:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1787381298.246934:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1787381298.247217:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1787381298.247393:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1787381298.247738:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1787381298.247908:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1787381298.248113:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1787381298.248264:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1787381298.248410:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1787381298.248586:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1787381298.250262:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1787381298.250476:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1787381298.250828:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1787381298.251032:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1787381298.251202:0:5771:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1787381298.251707:0:5771:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1787381298.272464:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1787381298.315380:0:5771:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787381298.315415:0:5771:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb6ca01db3988 00100000:10000000:1.0:1787381298.315423:0:5771:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787381298.316229:0:5771:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787381298.316242:0:5771:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.122@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787381298.316254:0:5771:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1787381298.316269:0:5771:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1787381298.321181:0:5826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787381298.321248:0:5826:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787381298.321252:0:5826:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1787381299.090946:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381300.109640:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381301.133208:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381302.156261:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787381303.117675:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b34fb375 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd19486c-5291-4823-bb9c-f3a73416a496:3310:1874205065874560:0@lo:400: 00000100:00100000:0.0:1787381303.117747:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787381303.117908:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787381303.117922:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787381303.117924:0:36:0:(import.c:65:import_set_state_nolock()) 000000006b7bc354 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787381303.117932:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000006b7bc354 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1787381303.117956:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f3cc0264 x1874205065874688/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787381303.117985:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f3cc0264 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874205065874688:0@lo:38: 00000100:00100000:2.0:1787381303.118046:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381303.118220:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065874688 00000100:00100000:0.0:1787381303.118230:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065874688 00000100:00100000:0.0:1787381303.118272:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787381303.118278:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e0a10c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1874205065874688:12345-0@lo:38: 00010000:00080000:0.0:1787381303.118302:0:5792:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 161 last 0 00000020:00000080:0.0:1787381303.118344:0:5792:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xbdc38ada7ea0f6fa 00000004:00100000:0.0:1787381303.118382:0:5792:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787381303.118480:0:5792:0:(import.c:65:import_set_state_nolock()) 0000000040b6421d : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787381303.118527:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e0a10c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874205065874688:12345-0@lo:38: Request processed in 249us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381303.118535:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787381303.118685:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f3cc0264 x1874205065874688/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787381313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787381303.118699:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787381303.118706:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787381303.118710:0:3307:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787381303.118712:0:3307:0:(import.c:65:import_set_state_nolock()) 000000006b7bc354 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787381303.118717:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f3cc0264 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874205065874688:0@lo:38: 00000100:00100000:3.0:1787381303.118797:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065874560 00000100:00100000:3.0:1787381303.118802:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065874560 00000100:00100000:3.0:1787381303.118840:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787381303.118922:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b6fa52c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+11:3310:x1874205065874560:12345-0@lo:400: 00000100:00100000:3.0:1787381303.118966:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b6fa52c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+11:3310:x1874205065874560:12345-0@lo:400: Request processed in 47us (1220us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381303.118972:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787381303.119679:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b34fb375 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd19486c-5291-4823-bb9c-f3a73416a496:3310:1874205065874560:0@lo:400: 00010000:00010000:1.0:1787381303.195655:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787381303.307864:0:6068:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787381304.206231:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381305.228237:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787381306.188146:0:5787:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787381306.188154:0:5787:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a16659a7000 from 3 10000000:01000000:0.0:1787381306.188159:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787381306.188213:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 0000000012722102/0xbdc38ada7ea0f701 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381306.188226:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 0000000012722102/0xbdc38ada7ea0f701 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381306.188236:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 0000000012722102/0xbdc38ada7ea0f701 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381306.188258:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b2eeaa1d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065874816:0@lo:101: 00000100:00100000:0.0:1787381306.188340:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381306.188409:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set 0000000084b1f8bb going to sleep for 11 seconds 00000100:00100000:1.0:1787381306.188554:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065874816 00000100:00100000:1.0:1787381306.188562:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065874816 00000100:00100000:1.0:1787381306.188621:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787381306.188628:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007132eeeb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+11:5787:x1874205065874816:12345-0@lo:101: 00010000:00010000:1.0:1787381306.188641:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381306.188653:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000304ef184/0xbdc38ada7ea0f708 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0f701 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381306.188676:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000304ef184/0xbdc38ada7ea0f708 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f701 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381306.188685:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000304ef184/0xbdc38ada7ea0f708 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f701 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381306.188694:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000304ef184, rc 0) 00000100:00100000:1.0:1787381306.188741:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007132eeeb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+12:5787:x1874205065874816:12345-0@lo:101: Request processed in 113us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381306.188748:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787381306.188959:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b2eeaa1d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065874816:0@lo:101: 00010000:00010000:0.0:1787381306.188973:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 0000000012722102/0xbdc38ada7ea0f701 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f708 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381306.188992:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 0000000012722102/0xbdc38ada7ea0f701 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f708 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381306.189059:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b2eeaa1d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065874944:0@lo:256: 00000100:00100000:0.0:1787381306.189089:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381306.189118:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set 0000000084b1f8bb going to sleep for 11 seconds 00000100:00100000:2.0:1787381306.189223:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065874944 00000100:00100000:2.0:1787381306.189227:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065874944 00000100:00100000:2.0:1787381306.189259:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787381306.189266:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000387bb183 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+12:5787:x1874205065874944:12345-0@lo:256: 20000000:01000000:2.0:1787381306.189281:0:5785:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787381306.189309:0:5785:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787381306.189313:0:5785:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1787381306.189397:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000387bb183 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+12:5787:x1874205065874944:12345-0@lo:256: Request processed in 132us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381306.189410:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787381306.189712:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b2eeaa1d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065874944:0@lo:256: 10000000:01000000:0.0:1787381306.189754:0:5787:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787381306.189760:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 0000000012722102/0xbdc38ada7ea0f701 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f708 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381306.189768:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 0000000012722102/0xbdc38ada7ea0f701 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f708 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381306.252672:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381307.289972:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787381308.236856:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000793815e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874205065875200:0@lo:400: 00000100:00100000:3.0:1787381308.236933:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381308.237064:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787381308.237074:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000010fead1e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd19486c-5291-4823-bb9c-f3a73416a496:3310:1874205065875072:0@lo:400: 00000100:00100000:0.0:1787381308.237108:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381308.237210:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065875200 00000100:00100000:1.0:1787381308.237219:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065875200 00000100:00100000:1.0:1787381308.237267:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787381308.237275:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b035042 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874205065875200:12345-0@lo:400: 00000100:00100000:1.0:1787381308.237346:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b035042 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874205065875200:12345-0@lo:400: Request processed in 72us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381308.237353:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787381308.237389:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000793815e5 x1874205065875200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787381324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381308.237403:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000793815e5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874205065875200:0@lo:400: 00000100:00100000:3.0:1787381308.237784:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065875072 00000100:00100000:3.0:1787381308.237790:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065875072 00000100:00100000:3.0:1787381308.237825:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787381308.237830:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bac1a3d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+12:3310:x1874205065875072:12345-0@lo:400: 00000100:00100000:3.0:1787381308.237954:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bac1a3d6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+12:3310:x1874205065875072:12345-0@lo:400: Request processed in 123us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381308.237960:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787381308.244665:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000010fead1e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd19486c-5291-4823-bb9c-f3a73416a496:3310:1874205065875072:0@lo:400: 00010000:00010000:0.0:1787381308.301955:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787381308.413683:0:6270:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffe69160360 00000020:00000080:1.0:1787381308.413703:0:6270:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:1.0:1787381308.413708:0:6270:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:1.0:1787381308.413716:0:6270:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe691625f0 20000000:00000080:1.0:1787381308.413722:0:6270:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a166fbf3c00 uarg=0000000000000000 20000000:01000000:1.0:1787381308.413755:0:6270:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787381308.413761:0:6270:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787381308.413765:0:6270:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787381308.413949:0:6270:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1787381308.413961:0:6270:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1787381308.429820:0:6270:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787381308.432841:0:6270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787381308.433114:0:6270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1787381308.433172:0:6270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1787381308.433191:0:6270:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787381308.433209:0:6270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000036b4661e/0xbdc38ada7ea0f70f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381308.433225:0:6270:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000077764a1b/0xbdc38ada7ea0f6d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f6c9 expref: 11 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381308.433231:0:6270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000036b4661e/0xbdc38ada7ea0f70f lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381308.433266:0:6270:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000077764a1b/0xbdc38ada7ea0f6d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbdc38ada7ea0f6c9 expref: 11 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381308.433298:0:6270:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000077764a1b/0xbdc38ada7ea0f6d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f6c9 expref: 11 pid: 5785 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381308.433312:0:6270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000582f6d84 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6270:1874205065875328:0@lo:104: 00000100:00100000:1.0:1787381308.433379:0:6270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381308.433429:0:6270:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cb448fe2 going to sleep for 11 seconds 00000100:00100000:2.0:1787381308.434737:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065875328 00000100:00100000:2.0:1787381308.434751:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065875328 00000100:00100000:2.0:1787381308.434816:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787381308.434823:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3a6d0b8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+3:6270:x1874205065875328:12345-0@lo:104: 00010000:00010000:2.0:1787381308.434836:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: 00000000be540742/0xbdc38ada7ea0f6c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f6d0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381308.434913:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787381308.434919:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3a6d0b8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+3:6270:x1874205065875328:12345-0@lo:104: Request processed in 97us (1541us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381308.434926:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787381308.435140:0:6270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000582f6d84 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6270:1874205065875328:0@lo:104: 00010000:00010000:0.0:1787381308.435161:0:6270:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000036b4661e/0xbdc38ada7ea0f70f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381308.435288:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787381308.435294:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: 00000000be540742/0xbdc38ada7ea0f6c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f6d0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381308.435308:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000be540742 already unused, calling callback (000000008ae671ec) 10000000:00010000:3.0:1787381308.435311:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: 00000000be540742/0xbdc38ada7ea0f6c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbdc38ada7ea0f6d0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381308.435318:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: 00000000be540742/0xbdc38ada7ea0f6c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbdc38ada7ea0f6d0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787381308.435324:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: 00000000be540742/0xbdc38ada7ea0f6c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbdc38ada7ea0f6d0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787381308.435330:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787381308.435373:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: 00000000be540742/0xbdc38ada7ea0f6c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f6d0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381308.435380:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787381308.435406:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: 00000000be540742/0xbdc38ada7ea0f6c9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f6d0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381308.435413:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: 00000000be540742/0xbdc38ada7ea0f6c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f6d0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381308.435427:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381308.435429:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381308.435431:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787381308.435437:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787381308.435616:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f6951f66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065875456:0@lo:103: 00000100:00100000:3.0:1787381308.435655:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381308.435723:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065875456 00000100:00100000:0.0:1787381308.435729:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065875456 00010000:00010000:0.0:1787381308.435748:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000077764a1b/0xbdc38ada7ea0f6d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f6c9 expref: 12 pid: 5785 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381308.435777:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787381308.435783:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e2dc328 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd19486c-5291-4823-bb9c-f3a73416a496+12:3308:x1874205065875456:12345-0@lo:103: 00010000:00010000:0.0:1787381308.435792:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787381308.435797:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000077764a1b/0xbdc38ada7ea0f6d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f6c9 expref: 12 pid: 5785 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381308.435805:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000077764a1b/0xbdc38ada7ea0f6d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f6c9 expref: 12 pid: 5785 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381308.435816:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000077764a1b/0xbdc38ada7ea0f6d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbdc38ada7ea0f6c9 expref: 12 pid: 5785 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381308.435836:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000036b4661e/0xbdc38ada7ea0f70f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381308.435841:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000036b4661e/0xbdc38ada7ea0f70f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381308.435854:0:5775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000036b4661e/0xbdc38ada7ea0f70f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381308.435860:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000036b4661e/0xbdc38ada7ea0f70f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381308.435866:0:5775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000036b4661e/0xbdc38ada7ea0f70f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381308.435871:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000036b4661e/0xbdc38ada7ea0f70f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381308.435876:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000036b4661e already unused, calling callback (000000009b9c7422) 00010000:00010000:0.0:1787381308.435880:0:5775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000036b4661e/0xbdc38ada7ea0f70f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381308.435885:0:5775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000036b4661e/0xbdc38ada7ea0f70f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381308.435904:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000036b4661e/0xbdc38ada7ea0f70f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381308.435914:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787381308.435942:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e2dc328 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd19486c-5291-4823-bb9c-f3a73416a496+11:3308:x1874205065875456:12345-0@lo:103: Request processed in 160us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381308.435958:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787381308.436112:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f6951f66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065875456:0@lo:103: 00010000:00010000:3.0:1787381308.436144:0:6270:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000036b4661e/0xbdc38ada7ea0f70f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381308.436150:0:6270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000036b4661e/0xbdc38ada7ea0f70f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381308.436155:0:6270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000036b4661e/0xbdc38ada7ea0f70f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381309.336812:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381310.350732:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381311.382172:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381312.397765:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787381313.365293:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f3cc0264 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd19486c-5291-4823-bb9c-f3a73416a496:3310:1874205065875584:0@lo:400: 00000100:00100000:1.0:1787381313.365378:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381313.365447:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787381313.365454:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000921811a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874205065875712:0@lo:400: 00000100:00100000:1.0:1787381313.365480:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381313.365519:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065875712 00000100:00100000:1.0:1787381313.365526:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065875712 00000100:00100000:1.0:1787381313.365569:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787381313.365576:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005aceb24f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874205065875712:12345-0@lo:400: 00000100:00100000:1.0:1787381313.365625:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005aceb24f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874205065875712:12345-0@lo:400: Request processed in 49us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381313.365632:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787381313.365669:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000921811a8 x1874205065875712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787381329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381313.365683:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000921811a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874205065875712:0@lo:400: 00000100:00100000:2.0:1787381313.367929:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065875584 00000100:00100000:2.0:1787381313.367943:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065875584 00000100:00100000:2.0:1787381313.367992:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787381313.368000:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a8da7a5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+11:3310:x1874205065875584:12345-0@lo:400: 00000100:00100000:2.0:1787381313.368096:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a8da7a5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+11:3310:x1874205065875584:12345-0@lo:400: Request processed in 98us (2718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381313.368104:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787381313.368471:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f3cc0264 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd19486c-5291-4823-bb9c-f3a73416a496:3310:1874205065875584:0@lo:400: 00010000:00010000:0.0:1787381313.423205:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787381313.868936:0:5787:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787381313.868942:0:5787:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a16659a7000 from 1 10000000:01000000:2.0:1787381313.868947:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787381313.868987:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 000000001fde134c/0xbdc38ada7ea0f716 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381313.868999:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 000000001fde134c/0xbdc38ada7ea0f716 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381313.869022:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 000000001fde134c/0xbdc38ada7ea0f716 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381313.869053:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000065c0d604 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065875840:0@lo:101: 00000100:00100000:2.0:1787381313.869127:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381313.869168:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set 00000000eb86beff going to sleep for 11 seconds 00000100:00100000:2.0:1787381313.869187:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065875840 00000100:00100000:2.0:1787381313.869194:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065875840 00000100:00100000:2.0:1787381313.869235:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787381313.869253:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f9d71c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+11:5787:x1874205065875840:12345-0@lo:101: 00010000:00010000:2.0:1787381313.869267:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381313.869280:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008571c7fc/0xbdc38ada7ea0f71d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0f716 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381313.869301:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008571c7fc/0xbdc38ada7ea0f71d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f716 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381313.869310:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008571c7fc/0xbdc38ada7ea0f71d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f716 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381313.869317:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008571c7fc, rc 0) 00000100:00100000:2.0:1787381313.869352:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f9d71c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+12:5787:x1874205065875840:12345-0@lo:101: Request processed in 111us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381313.869359:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787381313.869402:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000065c0d604 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065875840:0@lo:101: 00010000:00010000:2.0:1787381313.869612:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 000000001fde134c/0xbdc38ada7ea0f716 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f71d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381313.869621:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 000000001fde134c/0xbdc38ada7ea0f716 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f71d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381313.869669:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000065c0d604 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065875968:0@lo:501: 00000100:00100000:2.0:1787381313.869703:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381313.869740:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set 00000000eb86beff going to sleep for 11 seconds 00000100:00100000:3.0:1787381313.870184:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065875968 00000100:00100000:3.0:1787381313.870190:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065875968 00000100:00100000:3.0:1787381313.870224:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787381313.870230:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e055f189 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+12:5787:x1874205065875968:12345-0@lo:501: 00000100:00100000:3.0:1787381313.870467:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e055f189 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+12:5787:x1874205065875968:12345-0@lo:501: Request processed in 236us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381313.870474:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787381313.870511:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000065c0d604 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065875968:0@lo:501: 00000100:00100000:3.0:1787381313.870542:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f6951f66 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065876096:0@lo:503: 00000100:00100000:3.0:1787381313.870580:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381313.870602:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set 0000000011d59e20 going to sleep for 11 seconds 00000100:00100000:3.0:1787381313.870614:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065876096 00000100:00100000:3.0:1787381313.870618:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065876096 00000100:00100000:3.0:1787381313.870638:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787381313.870643:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e019881 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+12:5787:x1874205065876096:12345-0@lo:503: 00000100:00100000:3.0:1787381313.870788:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e019881 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+12:5787:x1874205065876096:12345-0@lo:503: Request processed in 145us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381313.870804:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787381313.870842:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f6951f66 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065876096:0@lo:503: 00000100:00100000:3.0:1787381313.871259:0:6585:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f6951f66 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:6585:1874205065876224:0@lo:502: 00000100:00100000:3.0:1787381313.871296:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381313.871318:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065876224 00000100:00100000:3.0:1787381313.871322:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065876224 00000100:00100000:3.0:1787381313.871348:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787381313.871353:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063f23687 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+12:6585:x1874205065876224:12345-0@lo:502: 00000100:00100000:3.0:1787381313.871492:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063f23687 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+12:6585:x1874205065876224:12345-0@lo:502: Request processed in 138us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381313.871498:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787381313.871527:0:6585:0:(client.c:2702:ptlrpc_set_wait()) set 0000000066ec58cd going to sleep for 11 seconds 00000100:00100000:3.0:1787381313.871538:0:6585:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f6951f66 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:6585:1874205065876224:0@lo:502: 00000020:01000000:3.0:1787381313.871557:0:6585:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787381313.871566:0:6585:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787381313.871568:0:6585:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787381313.871573:0:6585:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a16659a7000 00000020:00000080:3.0:1787381313.871575:0:6585:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787381313.871611:0:6585:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:6585:1874205065876352:0@lo:502: 00000100:00100000:3.0:1787381313.871640:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381313.871656:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065876352 00000100:00100000:3.0:1787381313.871659:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065876352 00000100:00100000:3.0:1787381313.871678:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787381313.871683:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+12:6585:x1874205065876352:12345-0@lo:502: 00000100:00100000:3.0:1787381313.871883:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+12:6585:x1874205065876352:12345-0@lo:502: Request processed in 198us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381313.871899:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787381313.871927:0:6585:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16505639c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787381313.871939:0:6585:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:6585:1874205065876352:0@lo:502: 00000020:01000000:3.0:1787381313.871956:0:6585:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787381313.871961:0:6585:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787381313.871962:0:6585:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787381313.871965:0:6585:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1787381313.872118:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787381313.872136:0:5787:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787381313.872145:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a164166ae00/0xbdc38ada7ea0f716 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f71d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381313.872155:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a164166ae00/0xbdc38ada7ea0f716 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f71d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787381314.311821:0:6584:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787381314.311825:0:6584:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787381314.311958:0:6584:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a1646496800 00000020:01000004:2.0:1787381314.311973:0:6584:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787381314.311985:0:6584:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787381314.311998:0:6584:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9a167b570000) 00000020:00000080:2.0:1787381314.312034:0:6584:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787381314.347928:0:6584:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787381314.350489:0:6584:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787381314.395063:0:6584:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787381314.406853:0:6584:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787381314.406889:0:6584:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787381314.406947:0:6584:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787381314.406973:0:6584:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787381314.407686:0:6584:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787381314.407696:0:6584:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787381314.407832:0:6584:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbdc38ada7ea0f72b 00000020:01000004:3.0:1787381314.407841:0:6584:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1787381314.407862:0:6584:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.122@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787381314.407866:0:6584:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.122@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787381314.407883:0:6584:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787381314.407887:0:6584:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787381314.407898:0:6584:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9a16483d3380) 00000020:00000080:3.0:1787381314.407908:0:6584:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1787381314.412918:0:6584:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787381314.413722:0:6584:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787381314.413731:0:6584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787381314.414656:0:6584:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787381314.414665:0:6584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787381314.417408:0:6584:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787381314.417420:0:6584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787381314.420511:0:6584:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787381314.420686:0:6584:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787381314.420693:0:6584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787381314.425891:0:6584:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787381314.425905:0:6584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00010000:00010000:3.0:1787381314.446394:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787381314.477906:0:6584:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787381314.478283:0:6584:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787381314.478290:0:6584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787381314.482148:0:6584:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787381314.482161:0:6584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787381314.485167:0:6584:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787381314.485250:0:6584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787381314.487217:0:6584:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787381314.487391:0:6584:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787381314.487396:0:6584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787381314.488033:0:6584:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787381314.488041:0:6584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787381314.669672:0:6584:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787381314.669986:0:6584:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787381314.670129:0:6584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787381314.686808:0:6584:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787381314.689981:0:6584:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787381314.690508:0:6584:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787381314.690530:0:6584:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1787381314.690535:0:6584:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.122@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787381314.730204:0:6584:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.122@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787381314.730262:0:6584:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.122@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1787381314.730266:0:6584:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787381314.730268:0:6584:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787381314.730269:0:6584:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787381314.730270:0:6584:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787381314.730271:0:6584:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787381314.730273:0:6584:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787381314.730274:0:6584:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787381314.730276:0:6584:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787381314.730277:0:6584:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787381314.730278:0:6584:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787381314.730280:0:6584:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787381314.730284:0:6584:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1787381314.730286:0:6584:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787381314.730287:0:6584:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787381314.730288:0:6584:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787381314.730289:0:6584:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787381314.730290:0:6584:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787381314.730291:0:6584:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787381314.730291:0:6584:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787381314.730292:0:6584:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787381314.730293:0:6584:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787381314.730294:0:6584:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787381314.730295:0:6584:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787381314.730327:0:6584:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787381314.730346:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:6584:1874205065876480:0@lo:253: 00000100:00100000:0.0:1787381314.730416:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381314.730470:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065876480 00000100:00100000:3.0:1787381314.730480:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065876480 00000100:00100000:0.0:1787381314.730530:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1665a6b600 going to sleep for 11 seconds 00000100:00100000:3.0:1787381314.730543:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787381314.730554:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+12:6584:x1874205065876480:12345-0@lo:253: 20000000:01000000:3.0:1787381314.730583:0:5783:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787381314.730586:0:5783:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1787381314.730590:0:5783:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1787381314.730593:0:5783:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1787381314.731538:0:5783:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787381314.732381:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1787381314.732399:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1787381314.732589:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1787381314.732599:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1787381314.732819:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1787381314.732878:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1787381314.734747:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1787381314.734776:0:5783:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.122@tcp 20000000:01000000:3.0:1787381314.734778:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.122@tcp (null) (null) (null) 00000040:00080000:3.0:1787381314.734833:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1787381314.734850:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787381314.734899:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1787381314.734907:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.122@tcp (null) (null) 00000040:00080000:3.0:1787381314.734934:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1787381314.734943:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787381314.734974:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1787381314.735066:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1787381314.738407:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1787381314.738501:0:5783:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.122@tcp 20000000:01000000:3.0:1787381314.738504:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.122@tcp (null) (null) (null) 00000040:00080000:3.0:1787381314.738544:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1787381314.738552:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787381314.738585:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1787381314.738592:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.122@tcp (null) (null) 00000040:00080000:3.0:1787381314.738640:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1787381314.738649:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787381314.738741:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1787381314.738777:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1787381314.738792:0:5783:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1787381314.738794:0:5783:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1787381314.738800:0:5783:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787381314.738801:0:5783:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787381314.738803:0:5783:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787381314.738815:0:5783:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787381314.738818:0:5783:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787381314.738847:0:5783:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787381314.738850:0:5783:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787381314.739898:0:6600:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1787381314.739953:0:6600:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1787381314.740189:0:6600:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1787381314.740840:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1787381314.740883:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1787381314.740934:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1787381314.740946:0:5783:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787381314.740949:0:5783:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787381314.741961:0:6601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1787381314.742520:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1787381314.742575:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1787381314.742646:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1787381314.742661:0:5783:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787381314.742663:0:5783:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787381314.743751:0:6602:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:1.0:1787381314.743819:0:6602:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:1.0:1787381314.743868:0:6602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1787381314.744365:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1787381314.744406:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1787381314.744546:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 10000000:01000000:2.0:1787381314.744566:0:5783:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787381314.744589:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a164166bc00/0xbdc38ada7ea0f739 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381314.744615:0:5783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a168216dc00/0xbdc38ada7ea0f652 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f64b expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381314.744622:0:5783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a168216c000/0xbdc38ada7ea0f66e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f667 expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381314.744628:0:5783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a16413a1600/0xbdc38ada7ea0f6de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f6d7 expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381314.744636:0:5783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a164166bc00/0xbdc38ada7ea0f739 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381314.744672:0:5783:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a16413a1600/0xbdc38ada7ea0f6de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbdc38ada7ea0f6d7 expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381314.744755:0:5783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a16413a1600/0xbdc38ada7ea0f6de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f6d7 expref: 12 pid: 5785 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381314.744770:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f4380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5783:1874205065876608:0@lo:104: 00000100:00100000:2.0:1787381314.744842:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787381314.744948:0:5783:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a168216c000/0xbdc38ada7ea0f66e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbdc38ada7ea0f667 expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381314.744956:0:5783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a168216c000/0xbdc38ada7ea0f66e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f667 expref: 12 pid: 5785 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381314.744965:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f5500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5783:1874205065876736:0@lo:104: 00000100:00100000:2.0:1787381314.744986:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787381314.745410:0:5783:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a168216dc00/0xbdc38ada7ea0f652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbdc38ada7ea0f64b expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381314.745532:0:5783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a168216dc00/0xbdc38ada7ea0f652 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f64b expref: 12 pid: 5784 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381314.745541:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f6300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5783:1874205065876864:0@lo:104: 00000100:00100000:2.0:1787381314.745568:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381314.745608:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065876608 00000100:00100000:3.0:1787381314.745616:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065876608 00000100:00100000:3.0:1787381314.745652:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065876736 00000100:00100000:3.0:1787381314.745655:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065876736 00000100:00100000:3.0:1787381314.745670:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787381314.745691:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+4:5783:x1874205065876608:12345-0@lo:104: 00010000:00010000:3.0:1787381314.745703:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9a164166a000/0xbdc38ada7ea0f6d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f6de expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381314.745769:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787381314.745775:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+4:5783:x1874205065876608:12345-0@lo:104: Request processed in 99us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381314.745782:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787381314.745798:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787381314.745805:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+3:5783:x1874205065876736:12345-0@lo:104: 00010000:00010000:3.0:1787381314.745811:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9a16413a0e00/0xbdc38ada7ea0f667 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f66e expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381314.745843:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787381314.745848:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+3:5783:x1874205065876736:12345-0@lo:104: Request processed in 44us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381314.745854:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787381314.745871:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787381314.745876:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a164166a000/0xbdc38ada7ea0f6d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f6de expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381314.745883:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a164166a000 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:3.0:1787381314.745893:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a164166a000/0xbdc38ada7ea0f6d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbdc38ada7ea0f6de expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381314.745901:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a164166a000/0xbdc38ada7ea0f6d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbdc38ada7ea0f6de expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787381314.745908:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a164166a000/0xbdc38ada7ea0f6d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbdc38ada7ea0f6de expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787381314.745914:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787381314.745944:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a164166a000/0xbdc38ada7ea0f6d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f6de expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381314.745950:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787381314.745968:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a164166a000/0xbdc38ada7ea0f6d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f6de expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381314.745974:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a164166a000/0xbdc38ada7ea0f6d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f6de expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381314.745987:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787381314.746001:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a16413a0e00/0xbdc38ada7ea0f667 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f66e expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381314.746030:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a0e00 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:3.0:1787381314.746034:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a16413a0e00/0xbdc38ada7ea0f667 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbdc38ada7ea0f66e expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381314.746040:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a16413a0e00/0xbdc38ada7ea0f667 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbdc38ada7ea0f66e expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787381314.746056:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a16413a0e00/0xbdc38ada7ea0f667 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbdc38ada7ea0f66e expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787381314.746061:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787381314.746084:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a16413a0e00/0xbdc38ada7ea0f667 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f66e expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381314.746091:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787381314.746097:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a16413a0e00/0xbdc38ada7ea0f667 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f66e expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381314.746103:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a16413a0e00/0xbdc38ada7ea0f667 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f66e expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381314.746113:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381314.746115:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381314.746117:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787381314.746136:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065876992:0@lo:103: 00000100:00100000:3.0:1787381314.746164:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381314.746193:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787381314.746200:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065877120:0@lo:103: 00000100:00100000:3.0:1787381314.746219:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381314.746259:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065876992 00000100:00100000:3.0:1787381314.746264:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065876992 00010000:00010000:3.0:1787381314.746281:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a16413a1600/0xbdc38ada7ea0f6de lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f6d7 expref: 13 pid: 5785 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381314.746301:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065877120 00000100:00100000:3.0:1787381314.746304:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065877120 00010000:00010000:3.0:1787381314.746323:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a168216c000/0xbdc38ada7ea0f66e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f667 expref: 14 pid: 5785 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381314.746337:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787381314.746343:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd19486c-5291-4823-bb9c-f3a73416a496+14:3308:x1874205065876992:12345-0@lo:103: 00010000:00010000:3.0:1787381314.746353:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787381314.746357:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a16413a1600/0xbdc38ada7ea0f6de lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f6d7 expref: 14 pid: 5785 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381314.746367:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a16413a1600/0xbdc38ada7ea0f6de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f6d7 expref: 14 pid: 5785 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381314.746382:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787381314.746409:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd19486c-5291-4823-bb9c-f3a73416a496+14:3308:x1874205065876992:12345-0@lo:103: Request processed in 66us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381314.746416:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787381314.746621:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787381314.746629:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd19486c-5291-4823-bb9c-f3a73416a496+13:3308:x1874205065877120:12345-0@lo:103: 00010000:00010000:3.0:1787381314.746638:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787381314.746643:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a168216c000/0xbdc38ada7ea0f66e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f667 expref: 13 pid: 5785 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381314.746652:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a168216c000/0xbdc38ada7ea0f66e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f667 expref: 13 pid: 5785 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381314.746661:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787381314.746685:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd19486c-5291-4823-bb9c-f3a73416a496+13:3308:x1874205065877120:12345-0@lo:103: Request processed in 56us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381314.746691:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787381314.746731:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065877120:0@lo:103: 00000100:00100000:3.0:1787381314.746739:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065876992:0@lo:103: 00010000:00010000:0.0:1787381314.746810:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787381314.747250:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1650ba1c00 going to sleep for 11 seconds 00010000:00010000:2.0:1787381314.747266:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a16413a1600/0xbdc38ada7ea0f6de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbdc38ada7ea0f6d7 expref: 12 pid: 5785 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381314.747279:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f4380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5783:1874205065876608:0@lo:104: 00010000:00010000:2.0:1787381314.747288:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a168216c000/0xbdc38ada7ea0f66e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbdc38ada7ea0f667 expref: 11 pid: 5785 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381314.747297:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f5500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5783:1874205065876736:0@lo:104: 00000100:00100000:3.0:1787381314.747340:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065876864 00000100:00100000:3.0:1787381314.747346:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065876864 00000100:00100000:3.0:1787381314.747412:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787381314.747434:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+3:5783:x1874205065876864:12345-0@lo:104: 00010000:00010000:3.0:1787381314.747444:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9a16413a0a00/0xbdc38ada7ea0f64b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f652 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381314.747505:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787381314.747511:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+3:5783:x1874205065876864:12345-0@lo:104: Request processed in 93us (1943us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381314.747518:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787381314.747564:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f6300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5783:1874205065876864:0@lo:104: 00010000:00010000:2.0:1787381314.747584:0:5783:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a164166bc00/0xbdc38ada7ea0f739 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381314.747714:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787381314.747721:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a16413a0a00/0xbdc38ada7ea0f64b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f652 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381314.747728:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a0a00 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:0.0:1787381314.747732:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a16413a0a00/0xbdc38ada7ea0f64b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbdc38ada7ea0f652 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381314.747741:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a16413a0a00/0xbdc38ada7ea0f64b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbdc38ada7ea0f652 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787381314.747749:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a16413a0a00/0xbdc38ada7ea0f64b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbdc38ada7ea0f652 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787381314.747755:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787381314.747790:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a16413a0a00/0xbdc38ada7ea0f64b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f652 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381314.747797:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787381314.747814:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a16413a0a00/0xbdc38ada7ea0f64b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f652 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381314.747820:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a16413a0a00/0xbdc38ada7ea0f64b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f652 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381314.747850:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381314.747852:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381314.747854:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787381314.747867:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd19486c-5291-4823-bb9c-f3a73416a496:3310:1874205065877248:0@lo:103: 00000100:00100000:0.0:1787381314.747901:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381314.748063:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065877248 00000100:00100000:2.0:1787381314.748068:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065877248 00010000:00010000:2.0:1787381314.748097:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a168216dc00/0xbdc38ada7ea0f652 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f64b expref: 11 pid: 5784 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381314.748121:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787381314.748127:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16461ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd19486c-5291-4823-bb9c-f3a73416a496+11:3310:x1874205065877248:12345-0@lo:103: 00010000:00010000:2.0:1787381314.748135:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381314.748139:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a168216dc00/0xbdc38ada7ea0f652 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f64b expref: 11 pid: 5784 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381314.748153:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a168216dc00/0xbdc38ada7ea0f652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f64b expref: 11 pid: 5784 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381314.748165:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a168216dc00/0xbdc38ada7ea0f652 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbdc38ada7ea0f64b expref: 11 pid: 5784 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381314.748179:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a164166bc00/0xbdc38ada7ea0f739 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381314.748187:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a164166bc00/0xbdc38ada7ea0f739 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381314.748200:0:5775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a164166bc00/0xbdc38ada7ea0f739 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381314.748207:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a164166bc00/0xbdc38ada7ea0f739 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381314.748213:0:5775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a164166bc00/0xbdc38ada7ea0f739 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381314.748219:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a164166bc00/0xbdc38ada7ea0f739 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381314.748224:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a164166bc00 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:2.0:1787381314.748229:0:5775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a164166bc00/0xbdc38ada7ea0f739 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381314.748246:0:5775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a164166bc00/0xbdc38ada7ea0f739 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381314.748270:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a164166bc00/0xbdc38ada7ea0f739 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381314.748279:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787381314.748311:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16461ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd19486c-5291-4823-bb9c-f3a73416a496+10:3310:x1874205065877248:12345-0@lo:103: Request processed in 184us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381314.748319:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787381314.748348:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd19486c-5291-4823-bb9c-f3a73416a496:3310:1874205065877248:0@lo:103: 00010000:00010000:2.0:1787381314.748366:0:5783:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a164166bc00/0xbdc38ada7ea0f739 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381314.748373:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a164166bc00/0xbdc38ada7ea0f739 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381314.748378:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a164166bc00/0xbdc38ada7ea0f739 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787381314.748390:0:5783:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787381314.883825:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+9:6584:x1874205065876480:12345-0@lo:253: Request processed in 153265us (153400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381314.883840:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787381314.883910:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:6584:1874205065876480:0@lo:253: 10000000:01000000:0.0:1787381314.883925:0:6584:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787381314.883928:0:6584:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787381314.883930:0:6584:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787381314.883931:0:6584:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787381314.883933:0:6584:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1787381314.883934:0:6584:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787381314.883935:0:6584:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787381314.883937:0:6584:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787381314.883938:0:6584:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787381314.883940:0:6584:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787381314.883941:0:6584:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787381314.883961:0:6584:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a1646496800 from lustre-OST0000 10000000:01000000:0.0:1787381314.883987:0:6584:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787381314.883990:0:6584:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787381314.883997:0:6584:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a1646130000 local copy 10000000:01000000:0.0:1787381314.884000:0:6584:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787381314.884088:0:6584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1640031000/0xbdc38ada7ea0f740 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381314.884100:0:6584:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.122@tcp lock: ffff9a1640031000/0xbdc38ada7ea0f740 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381314.884120:0:6584:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a1640031000/0xbdc38ada7ea0f740 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381314.884137:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:6584:1874205065877376:0@lo:101: 00000100:00100000:0.0:1787381314.884171:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381314.884371:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a164b7c8840 going to sleep for 11 seconds 00000100:00100000:2.0:1787381314.884664:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065877376 00000100:00100000:2.0:1787381314.884681:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065877376 00000100:00100000:2.0:1787381314.884728:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787381314.884738:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+9:6584:x1874205065877376:12345-0@lo:101: 00010000:00010000:2.0:1787381314.884751:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381314.884766:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a164166bc00/0xbdc38ada7ea0f747 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0f740 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381314.884789:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a164166bc00/0xbdc38ada7ea0f747 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f740 expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381314.884813:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a164166bc00/0xbdc38ada7ea0f747 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f740 expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381314.884823:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a164166bc00, rc 0) 00000100:00100000:2.0:1787381314.884871:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+10:6584:x1874205065877376:12345-0@lo:101: Request processed in 135us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381314.884877:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787381314.885135:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:6584:1874205065877376:0@lo:101: 00010000:00010000:0.0:1787381314.885149:0:6584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a1640031000/0xbdc38ada7ea0f740 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xbdc38ada7ea0f747 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381314.885158:0:6584:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a1640031000/0xbdc38ada7ea0f740 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbdc38ada7ea0f747 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381314.885282:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:6584:1874205065877504:0@lo:501: 00000100:00100000:0.0:1787381314.885313:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381314.885345:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a164b7c8840 going to sleep for 11 seconds 00000100:00100000:2.0:1787381314.885644:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065877504 00000100:00100000:2.0:1787381314.885650:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065877504 00000100:00100000:2.0:1787381314.885695:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787381314.885703:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+10:6584:x1874205065877504:12345-0@lo:501: 00000100:00100000:2.0:1787381314.885918:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+10:6584:x1874205065877504:12345-0@lo:501: Request processed in 215us (602us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787381314.885926:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787381314.886064:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:6584:1874205065877504:0@lo:501: 10000000:01000000:1.0:1787381314.886078:0:6584:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.122@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787381314.886107:0:6584:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.122@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787381314.886120:0:6584:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1640031000/0xbdc38ada7ea0f740 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbdc38ada7ea0f747 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381314.886129:0:6584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1640031000/0xbdc38ada7ea0f740 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbdc38ada7ea0f747 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381314.886136:0:6584:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9a1640031000/0xbdc38ada7ea0f740 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbdc38ada7ea0f747 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381314.886159:0:6584:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787381314.886178:0:6584:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a1646496800 10000000:01000000:1.0:1787381314.886182:0:6584:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787381314.886187:0:6584:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9a1646130000 10000000:01000000:1.0:1787381314.886189:0:6584:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787381314.886192:0:6584:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9a1646130000 from 1 10000000:01000000:1.0:1787381314.886195:0:6584:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787381314.886230:0:6584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a16413a0600/0xbdc38ada7ea0f74e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381314.886246:0:6584:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a16413a0600/0xbdc38ada7ea0f74e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381314.886253:0:6584:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a16413a0600/0xbdc38ada7ea0f74e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381314.886266:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:6584:1874205065877632:0@lo:101: 00000100:00100000:1.0:1787381314.886294:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381314.886323:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1644f1d300 going to sleep for 11 seconds 00000100:00100000:3.0:1787381314.886497:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065877632 00000100:00100000:3.0:1787381314.886502:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065877632 00000100:00100000:3.0:1787381314.886536:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787381314.886543:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+10:6584:x1874205065877632:12345-0@lo:101: 00010000:00010000:3.0:1787381314.886552:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381314.886563:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a168216ce00/0xbdc38ada7ea0f755 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0f74e expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381314.886580:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a168216ce00/0xbdc38ada7ea0f755 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f74e expref: 11 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381314.886589:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a168216ce00/0xbdc38ada7ea0f755 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f74e expref: 11 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381314.886596:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a168216ce00, rc 0) 00000100:00100000:3.0:1787381314.886631:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+11:6584:x1874205065877632:12345-0@lo:101: Request processed in 89us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381314.886637:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787381314.886806:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:6584:1874205065877632:0@lo:101: 00010000:00010000:1.0:1787381314.886817:0:6584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a16413a0600/0xbdc38ada7ea0f74e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f755 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381314.886830:0:6584:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a16413a0600/0xbdc38ada7ea0f74e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f755 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787381314.886846:0:6584:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787381314.886865:0:6584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a16413a0600/0xbdc38ada7ea0f74e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f755 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381314.886871:0:6584:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a16413a0600/0xbdc38ada7ea0f74e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f755 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787381314.886876:0:6584:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787381314.886879:0:6584:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787381314.886884:0:6584:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787381314.886886:0:6584:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787381314.886898:0:6584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a16413a1000/0xbdc38ada7ea0f75c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381314.886903:0:6584:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a16413a1000/0xbdc38ada7ea0f75c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381314.886909:0:6584:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a16413a1000/0xbdc38ada7ea0f75c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381314.886919:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:6584:1874205065877760:0@lo:101: 00000100:00100000:1.0:1787381314.886944:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381314.886965:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1644f1d300 going to sleep for 11 seconds 00000100:00100000:0.0:1787381314.887083:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065877760 00000100:00100000:0.0:1787381314.887087:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065877760 00000100:00100000:0.0:1787381314.887110:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787381314.887117:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+11:6584:x1874205065877760:12345-0@lo:101: 00010000:00010000:0.0:1787381314.887125:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381314.887132:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1640031e00/0xbdc38ada7ea0f763 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0f75c expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381314.887146:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1640031e00/0xbdc38ada7ea0f763 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f75c expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381314.887165:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1640031e00/0xbdc38ada7ea0f763 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f75c expref: 12 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381314.887172:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1640031e00, rc 0) 00000100:00100000:0.0:1787381314.887211:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+12:6584:x1874205065877760:12345-0@lo:101: Request processed in 94us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381314.887334:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:6584:1874205065877760:0@lo:101: 00010000:00010000:3.0:1787381314.887345:0:6584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a16413a1000/0xbdc38ada7ea0f75c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f763 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381314.887352:0:6584:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a16413a1000/0xbdc38ada7ea0f75c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f763 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381314.887495:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:6584:1874205065877888:0@lo:501: 00000100:00100000:3.0:1787381314.887519:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381314.887538:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16500fb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787381314.887577:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787381314.887599:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065877888 00000100:00100000:0.0:1787381314.887603:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065877888 00000100:00100000:0.0:1787381314.887617:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787381314.887622:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+12:6584:x1874205065877888:12345-0@lo:501: 00010000:00010000:2.0:1787381314.887767:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787381314.887774:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a1640031000/0xbdc38ada7ea0f740 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xbdc38ada7ea0f747 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381314.887781:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1640031000 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:2.0:1787381314.887784:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a1640031000/0xbdc38ada7ea0f740 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xbdc38ada7ea0f747 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381314.887792:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a1640031000/0xbdc38ada7ea0f740 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xbdc38ada7ea0f747 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787381314.887798:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a1640031000/0xbdc38ada7ea0f740 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xbdc38ada7ea0f747 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787381314.887814:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787381314.887833:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a1640031000/0xbdc38ada7ea0f740 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbdc38ada7ea0f747 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381314.887838:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787381314.887865:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a1640031000/0xbdc38ada7ea0f740 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbdc38ada7ea0f747 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381314.887871:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a1640031000/0xbdc38ada7ea0f740 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbdc38ada7ea0f747 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381314.887885:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381314.887887:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381314.887888:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787381314.887896:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787381314.887907:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd19486c-5291-4823-bb9c-f3a73416a496:3310:1874205065878016:0@lo:103: 00000100:00100000:2.0:1787381314.887937:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381314.888160:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+12:6584:x1874205065877888:12345-0@lo:501: Request processed in 537us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381314.888167:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787381314.888264:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065878016 00000100:00100000:1.0:1787381314.888269:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065878016 00000100:00100000:1.0:1787381314.888314:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787381314.888322:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd19486c-5291-4823-bb9c-f3a73416a496+12:3310:x1874205065878016:12345-0@lo:103: 00010000:00010000:1.0:1787381314.888331:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381314.888343:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a164166bc00/0xbdc38ada7ea0f747 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbdc38ada7ea0f740 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381314.888354:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381314.888385:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd19486c-5291-4823-bb9c-f3a73416a496+11:3310:x1874205065878016:12345-0@lo:103: Request processed in 64us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381314.888391:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787381314.888568:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd19486c-5291-4823-bb9c-f3a73416a496:3310:1874205065878016:0@lo:103: 00000100:00100000:2.0:1787381314.888777:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:6584:1874205065877888:0@lo:501: 00000100:00100000:2.0:1787381314.888808:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:6584:1874205065878144:0@lo:503: 00000100:00100000:2.0:1787381314.888847:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381314.888953:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a165827d840 going to sleep for 11 seconds 00000100:00100000:3.0:1787381314.891960:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065878144 00000100:00100000:3.0:1787381314.891974:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065878144 00000100:00100000:3.0:1787381314.892538:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787381314.892551:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+11:6584:x1874205065878144:12345-0@lo:503: 00000100:00100000:3.0:1787381314.892808:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+11:6584:x1874205065878144:12345-0@lo:503: Request processed in 259us (3960us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381314.892816:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787381314.892906:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:6584:1874205065878144:0@lo:503: 00000040:00080000:2.0:1787381314.893256:0:6584:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787381314.893333:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:6584:1874205065878272:0@lo:502: 00000100:00100000:2.0:1787381314.893377:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381314.903438:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a165827d840 going to sleep for 11 seconds 00000100:00100000:1.0:1787381314.907627:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065878272 00000100:00100000:1.0:1787381314.907643:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065878272 00000100:00100000:1.0:1787381314.908121:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787381314.908132:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+11:6584:x1874205065878272:12345-0@lo:502: 00000100:00100000:1.0:1787381314.908414:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+11:6584:x1874205065878272:12345-0@lo:502: Request processed in 284us (15035us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381314.908422:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787381314.908573:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:6584:1874205065878272:0@lo:502: 00000040:00080000:2.0:1787381314.908874:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787381314.908929:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787381314.908965:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787381314.909060:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787381314.909102:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787381314.909138:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787381314.909171:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:6584:1874205065878400:0@lo:502: 00000100:00100000:2.0:1787381314.909220:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381314.909279:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a165827d840 going to sleep for 11 seconds 00000100:00100000:1.0:1787381314.909685:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065878400 00000100:00100000:1.0:1787381314.909692:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065878400 00000100:00100000:1.0:1787381314.909725:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787381314.909732:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+11:6584:x1874205065878400:12345-0@lo:502: 00000100:00100000:1.0:1787381314.909905:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+11:6584:x1874205065878400:12345-0@lo:502: Request processed in 173us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381314.909913:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787381314.910056:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:6584:1874205065878400:0@lo:502: 00000040:00080000:2.0:1787381314.910171:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787381314.910184:0:6584:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1787381314.911671:0:6605:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787381314.911752:0:6605:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787381314.911760:0:6605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787381314.911762:0:6605:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787381314.911768:0:6605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787381314.911781:0:6605:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9a16483d4d40) 00000020:00000080:3.0:1787381314.911802:0:6605:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787381314.911808:0:6605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787381314.911884:0:6605:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a1646496800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787381314.911896:0:6605:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787381314.911903:0:6605:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbdc38ada7ea0f771 00010000:00010000:3.0:1787381314.923854:0:6605:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1787381314.925378:0:6605:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1787381314.932893:0:6605:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787381314.935888:0:6605:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1787381314.947668:0:6605:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1787381314.955055:0:6605:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1787381314.956857:0:6605:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787381314.956871:0:6605:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787381314.956888:0:6605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787381314.956890:0:6605:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787381314.956895:0:6605:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787381314.956900:0:6605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787381314.956901:0:6605:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787381314.956905:0:6605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787381314.956906:0:6605:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787381314.956956:0:6605:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787381314.956959:0:6605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787381314.956961:0:6605:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787381314.956964:0:6605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787381314.957209:0:6584:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1787381314.957253:0:6584:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787381314.957270:0:6584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a16413a1000/0xbdc38ada7ea0f75c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f763 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381314.957283:0:6584:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a16413a1000/0xbdc38ada7ea0f75c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f763 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787381314.957292:0:6584:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a1646496800 from 1 10000000:01000000:3.0:1787381314.957294:0:6584:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787381314.957328:0:6584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a168216c400/0xbdc38ada7ea0f778 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381314.957337:0:6584:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a168216c400/0xbdc38ada7ea0f778 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381314.957347:0:6584:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a168216c400/0xbdc38ada7ea0f778 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381314.957369:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:6584:1874205065878528:0@lo:101: 00000100:00100000:3.0:1787381314.957445:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381314.957485:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f94ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1787381314.960997:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065878528 00000100:00100000:1.0:1787381314.961030:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065878528 00000100:00100000:1.0:1787381314.961094:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787381314.961103:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+11:6584:x1874205065878528:12345-0@lo:101: 00010000:00010000:1.0:1787381314.961120:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381314.961138:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a16413a0e00/0xbdc38ada7ea0f77f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0f778 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381314.961164:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a16413a0e00/0xbdc38ada7ea0f77f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f778 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381314.961175:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a16413a0e00/0xbdc38ada7ea0f77f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f778 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381314.961185:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16413a0e00, rc 0) 00000100:00100000:1.0:1787381314.961262:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+12:6584:x1874205065878528:12345-0@lo:101: Request processed in 160us (3816us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381314.961269:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787381314.964246:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:6584:1874205065878528:0@lo:101: 00010000:00010000:3.0:1787381314.964278:0:6584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a168216c400/0xbdc38ada7ea0f778 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f77f expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381314.964291:0:6584:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a168216c400/0xbdc38ada7ea0f778 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f77f expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381314.964415:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:6584:1874205065878656:0@lo:501: 00000100:00100000:3.0:1787381314.964483:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381314.964522:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f94ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1787381314.968862:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065878656 00000100:00100000:0.0:1787381314.968892:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065878656 00000100:00100000:0.0:1787381314.968950:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787381314.968960:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+12:6584:x1874205065878656:12345-0@lo:501: 00000100:00100000:0.0:1787381314.971541:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+12:6584:x1874205065878656:12345-0@lo:501: Request processed in 2426us (6901us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381314.971557:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787381314.972527:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:6584:1874205065878656:0@lo:501: 00000100:00100000:3.0:1787381314.972583:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:6584:1874205065878784:0@lo:503: 00000100:00100000:3.0:1787381314.972643:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381314.972691:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f94ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1787381314.973051:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065878784 00000100:00100000:2.0:1787381314.973058:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065878784 00000100:00100000:2.0:1787381314.973102:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787381314.973112:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+12:6584:x1874205065878784:12345-0@lo:503: 00000100:00100000:2.0:1787381314.973572:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+12:6584:x1874205065878784:12345-0@lo:503: Request processed in 459us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381314.973579:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787381314.974464:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:6584:1874205065878784:0@lo:503: 00000040:00080000:0.0:1787381314.974856:0:6584:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787381314.974928:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461eca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:6584:1874205065878912:0@lo:502: 00000100:00100000:0.0:1787381314.974987:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381314.975042:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a164b7c8300 going to sleep for 11 seconds 00000100:00100000:0.0:1787381314.975064:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065878912 00000100:00100000:0.0:1787381314.975069:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065878912 00000100:00100000:0.0:1787381314.975105:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787381314.975114:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+12:6584:x1874205065878912:12345-0@lo:502: 00000100:00100000:0.0:1787381314.975336:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+12:6584:x1874205065878912:12345-0@lo:502: Request processed in 222us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381314.975343:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787381314.975390:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461eca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:6584:1874205065878912:0@lo:502: 00000040:00080000:0.0:1787381314.979651:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787381314.979754:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787381314.979798:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461eca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:6584:1874205065879040:0@lo:502: 00000100:00100000:0.0:1787381314.979876:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381314.979916:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a164b7c8300 going to sleep for 11 seconds 00000100:00100000:3.0:1787381314.980206:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065879040 00000100:00100000:3.0:1787381314.980227:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065879040 00000100:00100000:3.0:1787381314.980283:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787381314.980293:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+12:6584:x1874205065879040:12345-0@lo:502: 00000100:00100000:3.0:1787381314.980504:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+12:6584:x1874205065879040:12345-0@lo:502: Request processed in 211us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381314.980513:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787381314.981838:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461eca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:6584:1874205065879040:0@lo:502: 00000040:00080000:1.0:1787381314.981999:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787381314.982030:0:6584:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787381314.983963:0:6609:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787381314.983978:0:6609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787381314.983981:0:6609:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787381314.984001:0:6609:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a1646496800 00000020:00000080:0.0:1787381314.984033:0:6609:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787381314.984059:0:6609:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787381314.984062:0:6609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787381314.984064:0:6609:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787381314.984067:0:6609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787381314.984313:0:6584:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787381314.984335:0:6584:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787381314.984356:0:6584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a168216c400/0xbdc38ada7ea0f778 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f77f expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381314.984367:0:6584:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a168216c400/0xbdc38ada7ea0f778 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f77f expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787381314.984419:0:6584:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787381314.984422:0:6584:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a1646496800 10000000:01000000:1.0:1787381314.984431:0:6584:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a1646496800 10000000:01000000:1.0:1787381314.984436:0:6584:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787381314.984441:0:6584:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a1646496800 from 1 10000000:01000000:1.0:1787381314.984444:0:6584:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787381314.984477:0:6584:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a16413a1600/0xbdc38ada7ea0f786 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381314.984486:0:6584:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a16413a1600/0xbdc38ada7ea0f786 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381314.984496:0:6584:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a16413a1600/0xbdc38ada7ea0f786 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381314.984519:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:6584:1874205065879168:0@lo:101: 00000100:00100000:1.0:1787381314.984575:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381314.984609:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1644f1dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787381314.984780:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065879168 00000100:00100000:2.0:1787381314.984787:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065879168 00000100:00100000:2.0:1787381314.984834:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787381314.984844:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+12:6584:x1874205065879168:12345-0@lo:101: 00010000:00010000:2.0:1787381314.984857:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381314.984870:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a164166b200/0xbdc38ada7ea0f78d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0f786 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381314.984894:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a164166b200/0xbdc38ada7ea0f78d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f786 expref: 13 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381314.984916:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a164166b200/0xbdc38ada7ea0f78d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f786 expref: 13 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381314.984924:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a164166b200, rc 0) 00000100:00100000:2.0:1787381314.984972:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+13:6584:x1874205065879168:12345-0@lo:101: Request processed in 129us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381314.984979:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787381314.985164:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:6584:1874205065879168:0@lo:101: 00010000:00010000:0.0:1787381314.985178:0:6584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a16413a1600/0xbdc38ada7ea0f786 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f78d expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381314.985187:0:6584:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a16413a1600/0xbdc38ada7ea0f786 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f78d expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381314.985292:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:6584:1874205065879296:0@lo:501: 00000100:00100000:0.0:1787381314.985321:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381314.985351:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a164b7c8480 going to sleep for 11 seconds 00000100:00100000:2.0:1787381314.985498:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065879296 00000100:00100000:2.0:1787381314.985503:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065879296 00000100:00100000:2.0:1787381314.985536:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787381314.985544:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+13:6584:x1874205065879296:12345-0@lo:501: 00000100:00100000:2.0:1787381314.985793:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+13:6584:x1874205065879296:12345-0@lo:501: Request processed in 249us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381314.985801:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787381314.985966:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:6584:1874205065879296:0@lo:501: 00000100:00100000:0.0:1787381314.985995:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:6584:1874205065879424:0@lo:503: 00000100:00100000:0.0:1787381314.986058:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381314.986078:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a164b7c8480 going to sleep for 11 seconds 00000100:00100000:1.0:1787381314.986162:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065879424 00000100:00100000:1.0:1787381314.986167:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065879424 00000100:00100000:1.0:1787381314.986198:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787381314.986206:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+13:6584:x1874205065879424:12345-0@lo:503: 00000100:00100000:1.0:1787381314.986369:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+13:6584:x1874205065879424:12345-0@lo:503: Request processed in 164us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381314.986376:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787381314.992978:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461ef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:6584:1874205065879424:0@lo:503: 00000040:00080000:1.0:1787381314.993854:0:6584:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787381314.993933:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:6584:1874205065879552:0@lo:502: 00000100:00100000:1.0:1787381314.994039:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381314.994145:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1644f1db40 going to sleep for 11 seconds 00000100:00100000:3.0:1787381314.996769:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065879552 00000100:00100000:3.0:1787381314.996783:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065879552 00000100:00100000:0.0:1787381314.996902:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787381314.996912:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+13:6584:x1874205065879552:12345-0@lo:502: 00000100:00100000:0.0:1787381315.003895:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+13:6584:x1874205065879552:12345-0@lo:502: Request processed in 6975us (9847us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381315.003909:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787381315.004584:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:6584:1874205065879552:0@lo:502: 00000040:00080000:1.0:1787381315.004870:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787381315.004926:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787381315.004952:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787381315.004997:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787381315.005048:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787381315.005087:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787381315.005115:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787381315.005141:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787381315.005182:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787381315.005210:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787381315.005265:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787381315.005321:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787381315.005367:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787381315.005398:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787381315.005437:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787381315.005470:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787381315.005518:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787381315.005579:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787381315.005616:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787381315.005649:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787381315.005695:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787381315.005730:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787381315.005761:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787381315.005807:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787381315.005843:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1787381315.005872:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1787381315.005917:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1787381315.005953:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1787381315.005997:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:6584:1874205065879680:0@lo:502: 00000100:00100000:1.0:1787381315.006093:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381315.006150:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1644f1db40 going to sleep for 11 seconds 00000100:00100000:2.0:1787381315.006293:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065879680 00000100:00100000:2.0:1787381315.006301:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065879680 00000100:00100000:2.0:1787381315.006345:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787381315.006353:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1650553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+13:6584:x1874205065879680:12345-0@lo:502: 00000100:00100000:2.0:1787381315.006555:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1650553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+13:6584:x1874205065879680:12345-0@lo:502: Request processed in 202us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381315.006562:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787381315.006676:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:6584:1874205065879680:0@lo:502: 00000040:00080000:3.0:1787381315.006750:0:6584:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1787381315.006761:0:6584:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1787381315.008947:0:6610:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787381315.008981:0:6610:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9a167f9bcd40) 00000020:00000080:1.0:1787381315.009200:0:6610:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1787381315.009452:0:6610:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a1646496800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787381315.009456:0:6610:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a1646496800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787381315.009459:0:6610:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a1646496800 3 00010000:00080000:1.0:1787381315.009487:0:6610:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a164545b800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.122@tcp at head 00010000:00010000:1.0:1787381315.014073:0:6610:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1787381315.014181:0:6610:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787381315.014219:0:6610:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787381315.014231:0:6610:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xbdc38ada7ea0f79b 00000100:00080000:1.0:1787381315.020649:0:6610:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787381315.020663:0:6610:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a164545b800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:1.0:1787381315.020729:0:6610:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a167a33e680 x1874205065879808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787381315.020755:0:6610:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787381315.020816:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874205065879936:0@lo:400: 00000100:00100000:1.0:1787381315.020875:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381315.023399:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065879936 00000100:00100000:0.0:1787381315.023427:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065879936 00000100:00100000:0.0:1787381315.023474:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787381315.023482:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a33c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874205065879936:12345-0@lo:400: 00000100:00100000:0.0:1787381315.023580:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a33c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874205065879936:12345-0@lo:400: Request processed in 98us (2704us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381315.023588:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787381315.025686:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a167a33d500 x1874205065879936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787381331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787381315.025704:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874205065879936:0@lo:400: 00000100:00100000:3.0:1787381315.025835:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1874205065879808:0@lo:38: 00000100:00100000:3.0:1787381315.025901:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381315.025996:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065879808 00000100:00100000:2.0:1787381315.026028:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065879808 00000100:00100000:2.0:1787381315.026055:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787381315.026061:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3307:x1874205065879808:12345-0@lo:38: 00010000:00080000:2.0:1787381315.026085:0:5791:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:2.0:1787381315.026117:0:5791:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xbdc38ada7ea0f7a2 00000004:00100000:2.0:1787381315.026130:0:5791:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787381315.026161:0:5791:0:(import.c:65:import_set_state_nolock()) ffff9a167f6ed000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787381315.026213:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874205065879808:12345-0@lo:38: Request processed in 150us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381315.026220:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:1.0:1787381315.026427:0:6610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00010000:00080000:3.0:1787381315.026641:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a167a33e680 x1874205065879808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787381325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787381315.026651:0:3307:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787381315.026657:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1787381315.026664:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787381315.026669:0:3307:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787381315.026681:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9a164545b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787381315.026688:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1874205065879808:0@lo:38: 00000020:01000000:3.0:1787381315.026720:0:6584:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1787381315.026745:0:6584:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787381315.026767:0:6584:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a16413a1600/0xbdc38ada7ea0f786 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f78d expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381315.026779:0:6584:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a16413a1600/0xbdc38ada7ea0f786 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f78d expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787381315.026820:0:6584:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787381315.026822:0:6584:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787381315.026824:0:6584:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787381315.026825:0:6584:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787381315.026826:0:6584:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787381315.026828:0:6584:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787381315.026829:0:6584:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787381315.026831:0:6584:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787381315.026832:0:6584:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787381315.026834:0:6584:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787381315.026835:0:6584:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787381315.026839:0:6584:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1787381315.026841:0:6584:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787381315.026842:0:6584:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787381315.026846:0:6584:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787381315.026847:0:6584:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787381315.026848:0:6584:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787381315.026849:0:6584:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787381315.026850:0:6584:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787381315.026851:0:6584:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787381315.026852:0:6584:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787381315.026853:0:6584:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787381315.026854:0:6584:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787381315.026870:0:6584:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787381315.026880:0:6584:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:6584:1874205065880064:0@lo:253: 00000100:00100000:3.0:1787381315.026927:0:6584:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381315.026950:0:6584:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f94aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787381315.027121:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065880064 00000100:00100000:1.0:1787381315.027126:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065880064 00000100:00100000:1.0:1787381315.027158:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787381315.027164:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1650552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+13:6584:x1874205065880064:12345-0@lo:253: 20000000:01000000:1.0:1787381315.027182:0:5785:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787381315.027194:0:5785:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787381315.081283:0:5785:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787381315.081303:0:5785:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787381315.081411:0:5806:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787381315.081417:0:5806:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787381315.081439:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a1640031600/0xbdc38ada7ea0f7a9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381315.081458:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a16413a1400/0xbdc38ada7ea0f708 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f701 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381315.081465:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a1640031600/0xbdc38ada7ea0f7a9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381315.081502:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a16413a1400/0xbdc38ada7ea0f708 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbdc38ada7ea0f701 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381315.081516:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a16413a1400/0xbdc38ada7ea0f708 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f701 expref: 13 pid: 5783 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381315.081530:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461ef100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5806:1874205065880192:0@lo:104: 00000100:00100000:0.0:1787381315.081594:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381315.081657:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a166d06fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787381315.081897:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065880192 00000100:00100000:1.0:1787381315.081905:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065880192 00000100:00100000:1.0:1787381315.081965:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787381315.081974:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16461eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd19486c-5291-4823-bb9c-f3a73416a496+3:5806:x1874205065880192:12345-0@lo:104: 00010000:00010000:1.0:1787381315.081987:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9a1640030600/0xbdc38ada7ea0f701 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f708 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381315.082072:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787381315.082078:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16461eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd19486c-5291-4823-bb9c-f3a73416a496+3:5806:x1874205065880192:12345-0@lo:104: Request processed in 106us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381315.082086:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1787381315.082266:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787381315.082273:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a1640030600/0xbdc38ada7ea0f701 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f708 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381315.082280:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1640030600 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:0.0:1787381315.082290:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a1640030600/0xbdc38ada7ea0f701 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbdc38ada7ea0f708 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381315.082298:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a1640030600/0xbdc38ada7ea0f701 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbdc38ada7ea0f708 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787381315.082305:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a1640030600/0xbdc38ada7ea0f701 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbdc38ada7ea0f708 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787381315.082311:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787381315.082357:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a1640030600/0xbdc38ada7ea0f701 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f708 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381315.082364:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787381315.082390:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a1640030600/0xbdc38ada7ea0f701 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f708 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381315.082398:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a1640030600/0xbdc38ada7ea0f701 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f708 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381315.082414:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381315.082416:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381315.082417:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787381315.082425:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787381315.082436:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065880320:0@lo:103: 00000100:00100000:0.0:1787381315.082467:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381315.082503:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065880320 00000100:00100000:0.0:1787381315.082507:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065880320 00010000:00010000:0.0:1787381315.082525:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a16413a1400/0xbdc38ada7ea0f708 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f701 expref: 14 pid: 5783 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381315.082547:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787381315.082560:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166d05c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd19486c-5291-4823-bb9c-f3a73416a496+14:3308:x1874205065880320:12345-0@lo:103: 00010000:00010000:0.0:1787381315.082570:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787381315.082576:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a16413a1400/0xbdc38ada7ea0f708 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f701 expref: 14 pid: 5783 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381315.082586:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a16413a1400/0xbdc38ada7ea0f708 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f701 expref: 14 pid: 5783 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381315.082604:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a1640031600/0xbdc38ada7ea0f7a9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381315.082611:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1640031600/0xbdc38ada7ea0f7a9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787381315.082623:0:5777:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007392683s 00010000:00010000:0.0:1787381315.082627:0:5777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a1640031600/0xbdc38ada7ea0f7a9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381315.082635:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a1640031600/0xbdc38ada7ea0f7a9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381315.082641:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a1640031600/0xbdc38ada7ea0f7a9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381315.082647:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a1640031600/0xbdc38ada7ea0f7a9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381315.082653:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1640031600 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:0.0:1787381315.082657:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a1640031600/0xbdc38ada7ea0f7a9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381315.082663:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a1640031600/0xbdc38ada7ea0f7a9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381315.083468:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a1640031600/0xbdc38ada7ea0f7a9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381315.083481:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787381315.083546:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166d05c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd19486c-5291-4823-bb9c-f3a73416a496+14:3308:x1874205065880320:12345-0@lo:103: Request processed in 985us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381315.083555:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1787381315.083640:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a16413a1400/0xbdc38ada7ea0f708 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbdc38ada7ea0f701 expref: 13 pid: 5783 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381315.083653:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461ef100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5806:1874205065880192:0@lo:104: 00010000:00010000:0.0:1787381315.083842:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a1640031600/0xbdc38ada7ea0f7a9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381315.083853:0:5806:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a1640031600/0xbdc38ada7ea0f7a9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381315.083859:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a1640031600/0xbdc38ada7ea0f7a9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381315.083866:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1640031600/0xbdc38ada7ea0f7a9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381315.084895:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065880320:0@lo:103: 00000100:00100000:3.0:1787381315.094580:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1650552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+12:6584:x1874205065880064:12345-0@lo:253: Request processed in 67406us (67643us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381315.094594:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787381315.095059:0:6584:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:6584:1874205065880064:0@lo:253: 10000000:01000000:0.0:1787381315.095075:0:6584:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787381315.095079:0:6584:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787381315.095081:0:6584:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787381315.095082:0:6584:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787381315.095083:0:6584:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787381315.095098:0:6584:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787381315.095100:0:6584:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787381315.095101:0:6584:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787381315.095103:0:6584:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787381315.095104:0:6584:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787381315.095106:0:6584:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787381315.095107:0:6584:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787381315.095125:0:6584:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787381315.101581:0:6584:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787381315.102054:0:6584:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787381315.102300:0:6584:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787381315.102466:0:6584:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787381315.102668:0:6584:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787381315.103488:0:6584:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787381315.105293:0:6584:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1787381315.468370:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1787381315.479898:0:6584:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787381315.479908:0:6584:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787381315.479944:0:6584:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787381315.480028:0:6584:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.122@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787381315.480043:0:6584:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787381315.480076:0:6584:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1787381316.496188:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381317.517718:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381318.540402:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787381319.500151:0:5787:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787381319.500160:0:5787:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a16659a7000 from 21 10000000:01000000:2.0:1787381319.500166:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787381319.500223:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a164166b400/0xbdc38ada7ea0f7b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381319.500236:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a164166b400/0xbdc38ada7ea0f7b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381319.500249:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a164166b400/0xbdc38ada7ea0f7b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381319.500275:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065880448:0@lo:101: 00000100:00100000:2.0:1787381319.500563:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381319.500604:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065880448 00000100:00100000:1.0:1787381319.500614:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065880448 00000100:00100000:2.0:1787381319.500615:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167faff600 going to sleep for 11 seconds 00000100:00100000:1.0:1787381319.500677:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787381319.500687:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+12:5787:x1874205065880448:12345-0@lo:101: 00010000:00010000:1.0:1787381319.500702:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381319.500716:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a16413a0a00/0xbdc38ada7ea0f7b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0f7b0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381319.500741:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a16413a0a00/0xbdc38ada7ea0f7b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f7b0 expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381319.500752:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a16413a0a00/0xbdc38ada7ea0f7b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f7b0 expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381319.500761:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16413a0a00, rc 0) 00000100:00100000:1.0:1787381319.500819:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+13:5787:x1874205065880448:12345-0@lo:101: Request processed in 134us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381319.500826:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787381319.501590:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065880448:0@lo:101: 00010000:00010000:2.0:1787381319.501618:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a164166b400/0xbdc38ada7ea0f7b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f7b7 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381319.501628:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a164166b400/0xbdc38ada7ea0f7b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f7b7 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381319.501690:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065880576:0@lo:501: 00000100:00100000:2.0:1787381319.501734:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381319.501763:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065880576 00000100:00100000:2.0:1787381319.501766:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167faff600 going to sleep for 11 seconds 00000100:00100000:3.0:1787381319.501770:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065880576 00000100:00100000:3.0:1787381319.501807:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787381319.501815:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+13:5787:x1874205065880576:12345-0@lo:501: 00000100:00100000:3.0:1787381319.502197:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+13:5787:x1874205065880576:12345-0@lo:501: Request processed in 382us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381319.502215:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787381319.502254:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065880576:0@lo:501: 00000100:00100000:3.0:1787381319.502283:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065880704:0@lo:503: 00000100:00100000:3.0:1787381319.502321:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381319.502348:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1646080480 going to sleep for 11 seconds 00000100:00100000:3.0:1787381319.502378:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065880704 00000100:00100000:3.0:1787381319.502383:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065880704 00000100:00100000:3.0:1787381319.502405:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787381319.502411:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+13:5787:x1874205065880704:12345-0@lo:503: 00000100:00100000:3.0:1787381319.502677:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+13:5787:x1874205065880704:12345-0@lo:503: Request processed in 265us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381319.502684:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787381319.502722:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065880704:0@lo:503: 00000100:00100000:3.0:1787381319.502881:0:6780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:6780:1874205065880832:0@lo:502: 00000100:00100000:3.0:1787381319.502913:0:6780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381319.502931:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065880832 00000100:00100000:3.0:1787381319.502934:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065880832 00000100:00100000:3.0:1787381319.502953:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787381319.502958:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+13:6780:x1874205065880832:12345-0@lo:502: 00000100:00100000:3.0:1787381319.503165:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+13:6780:x1874205065880832:12345-0@lo:502: Request processed in 205us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381319.503171:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787381319.503217:0:6780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16460803c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787381319.503230:0:6780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:6780:1874205065880832:0@lo:502: 00000100:00100000:3.0:1787381319.503268:0:6780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:6780:1874205065880960:0@lo:502: 00000100:00100000:3.0:1787381319.503298:0:6780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381319.503316:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065880960 00000100:00100000:3.0:1787381319.503319:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065880960 00000100:00100000:3.0:1787381319.503337:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787381319.503343:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+13:6780:x1874205065880960:12345-0@lo:502: 00000100:00100000:3.0:1787381319.503447:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+13:6780:x1874205065880960:12345-0@lo:502: Request processed in 103us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381319.503453:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787381319.503480:0:6780:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16460803c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787381319.503497:0:6780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:6780:1874205065880960:0@lo:502: 00000040:00080000:3.0:1787381319.503513:0:6780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1787381319.503561:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1787381319.503579:0:5787:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787381319.503588:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a164166b400/0xbdc38ada7ea0f7b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f7b7 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381319.503599:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a164166b400/0xbdc38ada7ea0f7b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f7b7 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787381319.503609:0:5787:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787381319.503611:0:5787:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a16659a7000 from 4 10000000:01000000:3.0:1787381319.503614:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787381319.503641:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a168216c800/0xbdc38ada7ea0f7be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381319.503649:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a168216c800/0xbdc38ada7ea0f7be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381319.503657:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a168216c800/0xbdc38ada7ea0f7be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381319.503668:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065881088:0@lo:101: 00000100:00100000:3.0:1787381319.503693:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381319.503705:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16460803c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787381319.503718:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065881088 00000100:00100000:3.0:1787381319.503721:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065881088 00000100:00100000:3.0:1787381319.503740:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787381319.503746:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+13:5787:x1874205065881088:12345-0@lo:101: 00010000:00010000:3.0:1787381319.503753:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381319.503770:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a168216d200/0xbdc38ada7ea0f7c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0f7be expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381319.503790:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a168216d200/0xbdc38ada7ea0f7c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f7be expref: 14 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381319.503800:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a168216d200/0xbdc38ada7ea0f7c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f7be expref: 14 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381319.503808:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a168216d200, rc 0) 00000100:00100000:3.0:1787381319.503837:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+14:5787:x1874205065881088:12345-0@lo:101: Request processed in 91us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381319.503842:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787381319.503871:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065881088:0@lo:101: 00010000:00010000:3.0:1787381319.503882:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a168216c800/0xbdc38ada7ea0f7be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f7c5 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381319.503890:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a168216c800/0xbdc38ada7ea0f7be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f7c5 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381319.503929:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065881216:0@lo:256: 00000100:00100000:3.0:1787381319.503957:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381319.503970:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16460803c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787381319.503982:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065881216 00000100:00100000:3.0:1787381319.503984:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065881216 00000100:00100000:3.0:1787381319.504026:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787381319.504033:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+14:5787:x1874205065881216:12345-0@lo:256: 20000000:01000000:3.0:1787381319.504044:0:5783:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787381319.504059:0:5783:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787381319.504066:0:5783:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1787381319.504137:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+14:5787:x1874205065881216:12345-0@lo:256: Request processed in 105us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381319.504144:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787381319.504172:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065881216:0@lo:256: 10000000:01000000:3.0:1787381319.513840:0:5787:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787381319.513857:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a168216c800/0xbdc38ada7ea0f7be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f7c5 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381319.513871:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a168216c800/0xbdc38ada7ea0f7be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f7c5 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787381319.514729:0:5787:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787381319.514736:0:5787:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1787381319.514742:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787381319.514789:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a164166be00/0xbdc38ada7ea0f7cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381319.514800:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a164166be00/0xbdc38ada7ea0f7cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381319.514811:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a164166be00/0xbdc38ada7ea0f7cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381319.514834:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065881344:0@lo:101: 00000100:00100000:2.0:1787381319.514903:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381319.516567:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065881344 00000100:00100000:3.0:1787381319.516582:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065881344 00000100:00100000:3.0:1787381319.516647:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787381319.516656:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+14:5787:x1874205065881344:12345-0@lo:101: 00010000:00010000:3.0:1787381319.516672:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381319.516691:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a168216ca00/0xbdc38ada7ea0f7d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0f7cc expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381319.516719:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a168216ca00/0xbdc38ada7ea0f7d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f7cc expref: 15 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381319.516730:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a168216ca00/0xbdc38ada7ea0f7d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f7cc expref: 15 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381319.516739:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a168216ca00, rc 0) 00000100:00100000:3.0:1787381319.523944:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+15:5787:x1874205065881344:12345-0@lo:101: Request processed in 7280us (9031us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381319.523973:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787381319.526426:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167faff840 going to sleep for 11 seconds 00000100:00100000:2.0:1787381319.526470:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065881344:0@lo:101: 00010000:00010000:2.0:1787381319.526493:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a164166be00/0xbdc38ada7ea0f7cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f7d3 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381319.526505:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a164166be00/0xbdc38ada7ea0f7cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f7d3 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381319.526608:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065881472:0@lo:501: 00000100:00100000:2.0:1787381319.526790:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381319.526818:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167faff840 going to sleep for 11 seconds 00000100:00100000:0.0:1787381319.528099:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065881472 00000100:00100000:0.0:1787381319.528114:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065881472 00000100:00100000:0.0:1787381319.528175:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787381319.528185:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+15:5787:x1874205065881472:12345-0@lo:501: 00000100:00100000:0.0:1787381319.528506:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+15:5787:x1874205065881472:12345-0@lo:501: Request processed in 321us (1715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381319.528514:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787381319.528825:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065881472:0@lo:501: 00000100:00100000:1.0:1787381319.528877:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065881600:0@lo:503: 00000100:00100000:1.0:1787381319.528925:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381319.528965:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16430ad840 going to sleep for 11 seconds 00000100:00100000:3.0:1787381319.529066:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065881600 00000100:00100000:3.0:1787381319.529071:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065881600 00000100:00100000:3.0:1787381319.529100:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787381319.529108:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+15:5787:x1874205065881600:12345-0@lo:503: 00000100:00100000:3.0:1787381319.529435:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+15:5787:x1874205065881600:12345-0@lo:503: Request processed in 327us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381319.529443:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787381319.531318:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065881600:0@lo:503: 00000100:00100000:1.0:1787381319.531833:0:6781:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:6781:1874205065881728:0@lo:502: 00000100:00100000:1.0:1787381319.531899:0:6781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381319.531937:0:6781:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16430ad600 going to sleep for 11 seconds 00000100:00100000:0.0:1787381319.531994:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065881728 00000100:00100000:0.0:1787381319.532001:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065881728 00000100:00100000:0.0:1787381319.532073:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787381319.532082:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+15:6781:x1874205065881728:12345-0@lo:502: 00000100:00100000:0.0:1787381319.532393:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+15:6781:x1874205065881728:12345-0@lo:502: Request processed in 310us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381319.532403:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787381319.532634:0:6781:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:6781:1874205065881728:0@lo:502: 00000020:01000000:1.0:1787381319.532661:0:6781:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787381319.532669:0:6781:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787381319.532676:0:6781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787381319.532679:0:6781:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787381319.532688:0:6781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787381319.532692:0:6781:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.122@tcp to nid 0x20000c0a8cb7a (192.168.203.122@tcp) 00000020:01000000:1.0:1787381319.532714:0:6781:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787381319.532717:0:6781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787381319.532729:0:6781:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9a167f9b8000) 00000020:00000080:1.0:1787381319.532749:0:6781:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1787381319.532755:0:6781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787381319.532829:0:6781:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787381319.532834:0:6781:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787381319.532841:0:6781:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbdc38ada7ea0f7e1 00010000:00080000:1.0:1787381319.532871:0:6781:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a1646072800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.122@tcp at head 00010000:00010000:1.0:1787381319.533124:0:6781:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00010000:00010000:2.0:1787381319.569329:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1787381319.620347:0:6781:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787381319.620382:0:6781:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787381319.620974:0:6781:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787381319.621213:0:6781:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787381319.621262:0:6781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1787381319.621322:0:6781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1787381319.631624:0:6783:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787381319.631633:0:6783:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787381319.632682:0:6781:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787381319.632696:0:6781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787381319.632729:0:6781:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787381319.632749:0:6781:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbdc38ada7ea0f7e8 00000100:00080000:3.0:1787381319.632760:0:6781:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787381319.632767:0:6781:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a1646072800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:3.0:1787381319.632802:0:6781:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a1674ed7b80 x1874205065881856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787381319.632877:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1874205065881856:0@lo:8: 00000100:00100000:1.0:1787381319.632945:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381319.633057:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065881856 00000100:00100000:2.0:1787381319.633064:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065881856 00000100:00100000:2.0:1787381319.633095:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787381319.633102:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a33e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3307:x1874205065881856:12345-0@lo:8: 00010000:00080000:2.0:1787381319.633125:0:6587:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:2.0:1787381319.633161:0:6587:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbdc38ada7ea0f7ef 00002000:00100000:2.0:1787381319.633190:0:6587:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9a167f6ed800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113673 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787381319.633194:0:6587:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1787381319.633199:0:6587:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1787381319.633358:0:6587:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787381319.633521:0:6587:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787381319.633545:0:6587:0:(import.c:65:import_set_state_nolock()) ffff9a167f6ef800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1787381319.634329:0:6781:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787381319.634422:0:6781:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787381319.634430:0:6781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787381319.634432:0:6781:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787381319.634436:0:6781:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787381319.634440:0:6781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787381319.634442:0:6781:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787381319.634445:0:6781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787381319.634447:0:6781:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787381319.634673:0:6781:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:6781:1874205065881984:0@lo:502: 00000100:00100000:3.0:1787381319.634745:0:6781:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381319.634779:0:6781:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a165827d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787381319.634984:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065881984 00000100:00100000:0.0:1787381319.634992:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065881984 00000100:00100000:0.0:1787381319.635069:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787381319.635078:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+15:6781:x1874205065881984:12345-0@lo:502: 00000100:00100000:0.0:1787381319.635327:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+15:6781:x1874205065881984:12345-0@lo:502: Request processed in 249us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381319.635334:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787381319.635410:0:6781:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:6781:1874205065881984:0@lo:502: 00000020:01000000:0.0:1787381319.635436:0:6781:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787381319.635443:0:6781:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787381319.635444:0:6781:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787381319.635449:0:6781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1787381319.635523:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1787381319.635540:0:5787:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787381319.635550:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a164166be00/0xbdc38ada7ea0f7cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f7d3 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381319.635561:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a164166be00/0xbdc38ada7ea0f7cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f7d3 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787381319.635570:0:5787:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787381319.635573:0:5787:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9a1646130000 from 1 10000000:01000000:0.0:1787381319.635576:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787381319.635601:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1640031600/0xbdc38ada7ea0f7f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381319.635620:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a1640031600/0xbdc38ada7ea0f7f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381319.635629:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a1640031600/0xbdc38ada7ea0f7f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381319.635642:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065882112:0@lo:101: 00000100:00100000:0.0:1787381319.635671:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381319.635687:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1645b1f180 going to sleep for 11 seconds 00000100:00100000:0.0:1787381319.635701:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065882112 00000100:00100000:0.0:1787381319.635705:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065882112 00000100:00100000:0.0:1787381319.635726:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787381319.635733:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+15:5787:x1874205065882112:12345-0@lo:101: 00010000:00010000:0.0:1787381319.635741:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381319.635752:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1640031000/0xbdc38ada7ea0f7fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0f7f6 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381319.635771:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1640031000/0xbdc38ada7ea0f7fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f7f6 expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381319.635781:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1640031000/0xbdc38ada7ea0f7fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f7f6 expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381319.635790:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1640031000, rc 0) 00000100:00100000:0.0:1787381319.635816:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+16:5787:x1874205065882112:12345-0@lo:101: Request processed in 84us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381319.635822:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787381319.635848:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065882112:0@lo:101: 00010000:00010000:0.0:1787381319.635867:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a1640031600/0xbdc38ada7ea0f7f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f7fd expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381319.635875:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a1640031600/0xbdc38ada7ea0f7f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f7fd expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381319.635915:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065882240:0@lo:501: 00000100:00100000:0.0:1787381319.635938:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381319.635949:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1645b1f180 going to sleep for 11 seconds 00000100:00100000:0.0:1787381319.635959:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065882240 00000100:00100000:0.0:1787381319.635962:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065882240 00000100:00100000:0.0:1787381319.635976:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787381319.635980:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16461b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+16:5787:x1874205065882240:12345-0@lo:501: 00000100:00100000:0.0:1787381319.636180:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16461b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+16:5787:x1874205065882240:12345-0@lo:501: Request processed in 197us (239us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787381319.636187:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787381319.636225:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065882240:0@lo:501: 10000000:01000000:0.0:1787381319.636245:0:5787:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787381319.636249:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1640031600/0xbdc38ada7ea0f7f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f7fd expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381319.636257:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a1640031600/0xbdc38ada7ea0f7f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f7fd expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381319.644287:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874205065882368:0@lo:400: 00000100:00100000:0.0:1787381319.644409:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381319.644476:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787381319.644497:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1874205065882496:0@lo:400: 00000100:00100000:0.0:1787381319.644528:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381319.644573:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065882368 00000100:00100000:0.0:1787381319.644581:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065882368 00000100:00100000:0.0:1787381319.644623:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065882496 00000100:00100000:0.0:1787381319.644627:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065882496 00000100:00100000:0.0:1787381319.644656:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787381319.644664:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16461ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874205065882368:12345-0@lo:400: 00000100:00100000:0.0:1787381319.644728:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16461ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874205065882368:12345-0@lo:400: Request processed in 64us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381319.644735:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787381319.644752:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787381319.644758:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16461efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874205065882496:12345-0@lo:400: 00000100:00100000:0.0:1787381319.644785:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16461efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874205065882496:12345-0@lo:400: Request processed in 28us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381319.644792:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1787381319.644814:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787381319.644838:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a16461ec700 x1874205065882496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787381335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381319.644852:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1874205065882496:0@lo:400: 00010000:00080000:0.0:1787381319.644863:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a16461ef100 x1874205065882368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787381335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381319.644872:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874205065882368:0@lo:400: 00000100:00100000:2.0:1787381319.650299:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a33e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1874205065881856:12345-0@lo:8: Request processed in 17185us (17342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381319.650315:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787381319.655603:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a1674ed7b80 x1874205065881856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787381329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381319.655619:0:3307:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787381319.655630:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787381319.655639:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787381319.655647:0:3307:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787381319.655651:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9a1646072800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787381319.657108:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787381319.657126:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1874205065881856:0@lo:8: 00000004:00080000:0.0:1787381319.658133:0:6783:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787381319.658302:0:6783:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 177789296160ns, next at 0ns, rc = 0 00000004:00080000:0.0:1787381319.757732:0:5813:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1787381319.820103:0:6784:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787381319.820130:0:6784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6784:1874205065882752:0@lo:7: 00000100:00100000:3.0:1787381319.820213:0:6784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381319.820267:0:6784:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1674d98840 going to sleep for 11 seconds 00000100:00100000:3.0:1787381319.820286:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787381319.820333:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065882624:0@lo:13: 00000100:00100000:3.0:1787381319.820359:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381319.820403:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065882624 00000100:00100000:3.0:1787381319.820410:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065882624 00000100:00100000:3.0:1787381319.820458:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787381319.820466:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1874205065882624:12345-0@lo:13: 00002000:00000024:3.0:1787381319.820496:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1787381319.820541:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1874205065882624:12345-0@lo:13: Request processed in 76us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381319.820549:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787381319.820571:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787381319.820598:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a1674ed4e00 x1874205065882624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381335 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787381319.820615:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065882624:0@lo:13: 00000100:00100000:2.0:1787381319.820785:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065882752 00000100:00100000:2.0:1787381319.820790:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065882752 00000100:00100000:2.0:1787381319.820860:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787381319.820869:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6784:x1874205065882752:12345-0@lo:7: 00002000:00080000:2.0:1787381319.834785:0:6590:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1787381319.834794:0:6590:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787381319.834886:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6784:x1874205065882752:12345-0@lo:7: Request processed in 14015us (14677us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381319.834904:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787381319.835530:0:6784:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a1674ed5180 x1874205065882752/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787381335 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787381319.835547:0:6784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6784:1874205065882752:0@lo:7: 00000004:00080000:3.0:1787381319.835560:0:6784:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787381319.835607:0:6784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6784:1874205065882880:0@lo:5: 00000100:00100000:3.0:1787381319.835646:0:6784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381319.835686:0:6784:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1674d98840 going to sleep for 11 seconds 00000100:00100000:2.0:1787381319.835932:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065882880 00000100:00100000:2.0:1787381319.835938:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065882880 00000100:00100000:2.0:1787381319.835984:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787381319.835993:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6784:x1874205065882880:12345-0@lo:5: 00002000:00080000:2.0:1787381319.836159:0:6588:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787381319.836162:0:6588:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1787381319.836472:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6784:x1874205065882880:12345-0@lo:5: Request processed in 478us (824us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787381319.836480:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787381319.836565:0:6784:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a1674ed5180 x1874205065882880/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787381335 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381319.836578:0:6784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6784:1874205065882880:0@lo:5: 00000004:00080000:0.0:1787381319.836587:0:6784:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787381319.836625:0:6784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461ef100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6784:1874205065883008:0@lo:700: 00000100:00100000:0.0:1787381319.836654:0:6784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381319.836675:0:6784:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1645a34180 going to sleep for 11 seconds 00000100:00100000:2.0:1787381319.837715:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065883008 00000100:00100000:2.0:1787381319.837723:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065883008 00000100:00100000:2.0:1787381319.837759:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787381319.837766:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16461ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6784:x1874205065883008:12345-0@lo:700: 00000100:00100000:2.0:1787381319.837803:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6596:1874205065883136:0@lo:700: 00000100:00100000:2.0:1787381319.837856:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381319.838830:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167faff0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787381319.839414:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065883136 00000100:00100000:2.0:1787381319.839423:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065883136 00000100:00100000:2.0:1787381319.839538:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787381319.839547:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6596:x1874205065883136:12345-0@lo:700: 40000000:02000000:2.0:1787381319.887077:0:5797:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1787381319.893575:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6596:x1874205065883136:12345-0@lo:700: Request processed in 54021us (55709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381319.893590:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787381319.893668:0:6596:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a167a6f7480 x1874205065883136/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787381335 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381319.893683:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6596:1874205065883136:0@lo:700: 40000000:02000000:0.0:1787381319.893695:0:6596:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:1.0:1787381319.992873:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1787381319.992890:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787381319.993696:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16461ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6784:x1874205065883008:12345-0@lo:700: Request processed in 155924us (157034us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381319.993714:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787381319.993805:0:6784:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a16461ef100 x1874205065883008/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787381335 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381319.993816:0:6784:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787381319.993832:0:6784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461ef100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6784:1874205065883008:0@lo:700: 00000004:02000040:0.0:1787381320.038797:0:6784:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1787381320.048153:0:6784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461ef100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6784:1874205065883264:0@lo:5: 00000100:00100000:0.0:1787381320.050634:0:6784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381320.050696:0:6784:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1645a34d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787381320.050823:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065883264 00000100:00100000:3.0:1787381320.050833:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065883264 00000100:00100000:3.0:1787381320.050887:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787381320.050897:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16461eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6784:x1874205065883264:12345-0@lo:5: 00002000:00080000:2.0:1787381320.074398:0:6590:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1787381320.074417:0:6590:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1787381320.079736:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16461eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6784:x1874205065883264:12345-0@lo:5: Request processed in 28832us (29100us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787381320.079750:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787381320.080459:0:6784:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a16461ef100 x1874205065883264/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787381336 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381320.080477:0:6784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461ef100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6784:1874205065883264:0@lo:5: 00000004:00080000:0.0:1787381320.080491:0:6784:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1787381320.591361:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381321.613770:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381322.637747:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787381322.723789:0:6958:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787381323.665794:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381324.689640:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787381325.138782:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065883392:0@lo:13: 00000100:00100000:1.0:1787381325.138803:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd19486c-5291-4823-bb9c-f3a73416a496:3310:1874205065883520:0@lo:400: 00000100:00100000:0.0:1787381325.138851:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381325.138853:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381325.139073:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065883392 00000100:00100000:2.0:1787381325.139091:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065883392 00000100:00100000:2.0:1787381325.139138:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787381325.139145:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16461ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1874205065883392:12345-0@lo:13: 00002000:00000024:2.0:1787381325.139183:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787381325.139222:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16461ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1874205065883392:12345-0@lo:13: Request processed in 77us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381325.139228:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787381325.139695:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a16461ece00 x1874205065883392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381341 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381325.139714:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065883392:0@lo:13: 00000100:00100000:0.0:1787381325.139735:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065883904:0@lo:400: 00000100:00100000:0.0:1787381325.139761:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381325.139796:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787381325.139802:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1874205065883776:0@lo:400: 00000100:00100000:0.0:1787381325.139825:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381325.139853:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065883520 00000100:00100000:0.0:1787381325.139858:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065883520 00000100:00100000:0.0:1787381325.139884:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787381325.139892:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+16:3310:x1874205065883520:12345-0@lo:400: 00000100:00100000:0.0:1787381325.139923:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+16:3310:x1874205065883520:12345-0@lo:400: Request processed in 33us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381325.139930:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787381325.139958:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065883904 00000100:00100000:0.0:1787381325.139961:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065883904 00000100:00100000:0.0:1787381325.139984:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787381325.139991:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16461ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1874205065883904:12345-0@lo:400: 00000100:00100000:0.0:1787381325.140041:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16461ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1874205065883904:12345-0@lo:400: Request processed in 51us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381325.140047:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787381325.140063:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065883776 00000100:00100000:0.0:1787381325.140065:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065883776 00000100:00100000:0.0:1787381325.140218:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787381325.140224:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16461ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874205065883776:12345-0@lo:400: 00000100:00100000:0.0:1787381325.140383:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16461ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874205065883776:12345-0@lo:400: Request processed in 158us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381325.140390:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787381325.140429:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a167a33f480 x1874205065883776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787381341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381325.140440:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1874205065883776:0@lo:400: 00010000:00080000:0.0:1787381325.140450:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a167a33f800 x1874205065883904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787381341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381325.140459:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065883904:0@lo:400: 00000100:00080000:0.0:1787381325.140555:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787381325.140559:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787381325.143193:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd19486c-5291-4823-bb9c-f3a73416a496:3310:1874205065883520:0@lo:400: 00000100:00100000:1.0:1787381325.143223:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787381325.144149:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874205065883648:0@lo:400: 00000100:00100000:0.0:1787381325.144225:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381325.144273:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065883648 00000100:00100000:0.0:1787381325.144279:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065883648 00000100:00100000:0.0:1787381325.144321:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787381325.144329:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16461ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874205065883648:12345-0@lo:400: 00000100:00100000:0.0:1787381325.144380:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16461ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874205065883648:12345-0@lo:400: Request processed in 50us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381325.144387:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787381325.144898:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a167a33c700 x1874205065883648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787381341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381325.144909:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874205065883648:0@lo:400: 00000001:00080000:1.0:1787381325.230779:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1787381325.708088:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381326.742732:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381327.756274:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381328.780514:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381329.804131:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787381330.255766:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787381330.255788:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065884032:0@lo:13: 00000100:00100000:2.0:1787381330.255857:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381330.255916:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065884032 00000100:00100000:2.0:1787381330.255923:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065884032 00000100:00100000:2.0:1787381330.255975:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787381330.255983:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065884032:12345-0@lo:13: 00002000:00000024:2.0:1787381330.256053:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787381330.256098:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065884032:12345-0@lo:13: Request processed in 115us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381330.256105:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787381330.256139:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787381330.256167:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a167a6f5880 x1874205065884032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381346 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787381330.256177:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787381330.256197:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065884032:0@lo:13: 00000100:00100000:2.0:1787381330.265260:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd19486c-5291-4823-bb9c-f3a73416a496:3311:1874205065884160:0@lo:400: 00000100:00100000:2.0:1787381330.265344:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381330.266539:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065884160 00000100:00100000:0.0:1787381330.266551:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065884160 00000100:00100000:0.0:1787381330.266606:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787381330.266616:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+16:3311:x1874205065884160:12345-0@lo:400: 00000100:00100000:3.0:1787381330.268802:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1874205065884416:0@lo:400: 00000100:00100000:3.0:1787381330.268869:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381330.268910:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787381330.268917:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874205065884288:0@lo:400: 00000100:00100000:3.0:1787381330.268939:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381330.275508:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+16:3311:x1874205065884160:12345-0@lo:400: Request processed in 8872us (10142us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381330.275522:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787381330.275594:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065884416 00000100:00100000:0.0:1787381330.275603:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065884416 00000100:00100000:0.0:1787381330.275647:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065884288 00000100:00100000:0.0:1787381330.275650:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065884288 00000100:00100000:0.0:1787381330.275664:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787381330.275671:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874205065884416:12345-0@lo:400: 00000100:00100000:0.0:1787381330.275739:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874205065884416:12345-0@lo:400: Request processed in 68us (6871us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381330.275746:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787381330.275758:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787381330.275763:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874205065884288:12345-0@lo:400: 00000100:00100000:0.0:1787381330.275788:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874205065884288:12345-0@lo:400: Request processed in 25us (6848us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381330.275793:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1787381330.275811:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787381330.275847:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a1674ed5180 x1874205065884288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787381346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381330.275862:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874205065884288:0@lo:400: 00010000:00080000:0.0:1787381330.275873:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a1674ed7b80 x1874205065884416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787381346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381330.275894:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1874205065884416:0@lo:400: 00000100:00100000:2.0:1787381330.278264:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd19486c-5291-4823-bb9c-f3a73416a496:3311:1874205065884160:0@lo:400: 00010000:00010000:2.0:1787381330.830761:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381331.852348:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381332.876151:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787381333.603869:0:7464:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787381333.603874:0:7464:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1787381333.603985:0:7464:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a16436a3000 00000020:01000004:1.0:1787381333.604000:0:7464:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787381333.604054:0:7464:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1787381333.604072:0:7464:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9a167f9b99c0) 00000020:00000080:1.0:1787381333.604088:0:7464:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787381333.638585:0:7464:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1787381333.638795:0:7464:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787381333.672551:0:7464:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787381333.695504:0:7464:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787381333.695541:0:7464:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787381333.695602:0:7464:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787381333.695627:0:7464:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787381333.695953:0:7464:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787381333.695965:0:7464:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787381333.695976:0:7464:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbdc38ada7ea0f80b 00000020:01000004:3.0:1787381333.695984:0:7464:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787381333.696036:0:7464:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.122@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787381333.696040:0:7464:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.122@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787381333.696045:0:7464:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787381333.696067:0:7464:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787381333.696070:0:7464:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.122@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787381333.748906:0:7464:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.122@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787381333.749756:0:7464:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.122@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1787381333.749762:0:7464:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787381333.749764:0:7464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787381333.749765:0:7464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787381333.749766:0:7464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787381333.749767:0:7464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787381333.749769:0:7464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787381333.749770:0:7464:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787381333.749888:0:7464:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787381333.749889:0:7464:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787381333.749891:0:7464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787381333.749892:0:7464:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787381333.749896:0:7464:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1787381333.749898:0:7464:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787381333.749900:0:7464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787381333.749901:0:7464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787381333.749902:0:7464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787381333.749903:0:7464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787381333.749904:0:7464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787381333.749905:0:7464:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787381333.749906:0:7464:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787381333.749907:0:7464:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787381333.749908:0:7464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787381333.749909:0:7464:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787381333.751121:0:7464:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787381333.751147:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:7464:1874205065884544:0@lo:253: 00000100:00100000:0.0:1787381333.751216:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381333.751387:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1646dc3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787381333.751676:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065884544 00000100:00100000:2.0:1787381333.751684:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065884544 00000100:00100000:2.0:1787381333.751734:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787381333.751743:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+16:7464:x1874205065884544:12345-0@lo:253: 20000000:01000000:2.0:1787381333.751890:0:5783:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1787381333.751895:0:5783:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1787381333.751900:0:5783:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1787381333.751903:0:5783:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1787381333.755410:0:5783:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787381333.757259:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1787381333.757347:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1787381333.757673:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1787381333.757762:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1787381333.758227:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1787381333.758372:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1787381333.761415:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1787381333.761459:0:5783:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.122@tcp 20000000:01000000:3.0:1787381333.761462:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.122@tcp (null) (null) (null) 00000040:00080000:3.0:1787381333.761580:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1787381333.761591:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787381333.761667:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1787381333.761677:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.122@tcp (null) (null) 00000040:00080000:3.0:1787381333.762239:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1787381333.762251:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787381333.762559:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1787381333.762641:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1787381333.766979:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1787381333.767039:0:5783:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.122@tcp 20000000:01000000:3.0:1787381333.767042:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.122@tcp (null) (null) (null) 00000040:00080000:3.0:1787381333.767087:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1787381333.767096:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787381333.767805:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1787381333.767816:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.122@tcp (null) (null) 00000040:00080000:3.0:1787381333.767850:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1787381333.767860:0:5783:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787381333.767917:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1787381333.767954:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1787381333.767973:0:5783:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787381333.767976:0:5783:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787381333.767979:0:5783:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787381333.767991:0:5783:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787381333.767993:0:5783:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787381333.768072:0:5783:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787381333.768075:0:5783:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787381333.775117:0:7467:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1787381333.775238:0:7467:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1787381333.775817:0:7467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1787381333.776215:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1787381333.776260:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1787381333.776766:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1787381333.776782:0:5783:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787381333.776784:0:5783:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787381333.777588:0:7468:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1787381333.777661:0:7468:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1787381333.777827:0:7468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1787381333.778225:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1787381333.778805:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1787381333.778878:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1787381333.778894:0:5783:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787381333.778897:0:5783:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787381333.779589:0:7469:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1787381333.779640:0:7469:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1787381333.779706:0:7469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1787381333.780088:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1787381333.780147:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1787381333.780220:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1787381333.780234:0:5783:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787381333.780236:0:5783:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787381333.781128:0:7470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1787381333.781376:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1787381333.781415:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1787381333.781670:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1787381333.781764:0:5783:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1787381333.781767:0:5783:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1787381333.781776:0:5783:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787381333.781794:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a16413a1800/0xbdc38ada7ea0f812 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381333.781812:0:5783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a1640031e00/0xbdc38ada7ea0f763 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f75c expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381333.781821:0:5783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a164166b200/0xbdc38ada7ea0f78d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f786 expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381333.781828:0:5783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a16413a0a00/0xbdc38ada7ea0f7b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f7b0 expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381333.781835:0:5783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a168216ca00/0xbdc38ada7ea0f7d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f7cc expref: 16 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381333.781841:0:5783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a1640031000/0xbdc38ada7ea0f7fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f7f6 expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381333.781859:0:5783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a16413a1800/0xbdc38ada7ea0f812 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381333.781896:0:5783:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a1640031000/0xbdc38ada7ea0f7fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbdc38ada7ea0f7f6 expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381333.781910:0:5783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a1640031000/0xbdc38ada7ea0f7fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f7f6 expref: 16 pid: 5785 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381333.781924:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5783:1874205065884672:0@lo:104: 00000100:00100000:1.0:1787381333.781984:0:5783:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787381333.782118:0:5783:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a168216ca00/0xbdc38ada7ea0f7d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbdc38ada7ea0f7cc expref: 16 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381333.782127:0:5783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a168216ca00/0xbdc38ada7ea0f7d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f7cc expref: 16 pid: 5783 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381333.782137:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5783:1874205065884800:0@lo:104: 00010000:00010000:1.0:1787381333.782163:0:5783:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a16413a0a00/0xbdc38ada7ea0f7b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbdc38ada7ea0f7b0 expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381333.782171:0:5783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a16413a0a00/0xbdc38ada7ea0f7b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f7b0 expref: 16 pid: 5784 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381333.782179:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5783:1874205065884928:0@lo:104: 00010000:00010000:1.0:1787381333.782203:0:5783:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a164166b200/0xbdc38ada7ea0f78d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbdc38ada7ea0f786 expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381333.782210:0:5783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a164166b200/0xbdc38ada7ea0f78d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f786 expref: 16 pid: 5785 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381333.782225:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5783:1874205065885056:0@lo:104: 00010000:00010000:1.0:1787381333.782262:0:5783:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a1640031e00/0xbdc38ada7ea0f763 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbdc38ada7ea0f75c expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381333.782282:0:5783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a1640031e00/0xbdc38ada7ea0f763 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f75c expref: 16 pid: 5785 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381333.782291:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5783:1874205065885184:0@lo:104: 00000100:00100000:1.0:1787381333.782312:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1642b909c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787381333.787174:0:5773:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787381333.787222:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381333.787263:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381333.787352:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065884672 00000100:00100000:1.0:1787381333.787362:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065884672 00000100:00100000:1.0:1787381333.787401:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065884800 00000100:00100000:1.0:1787381333.787404:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065884800 00000100:00100000:1.0:1787381333.787416:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787381333.787439:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ee5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd19486c-5291-4823-bb9c-f3a73416a496+4:5783:x1874205065884672:12345-0@lo:104: 00010000:00010000:1.0:1787381333.787457:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9a1640031600/0xbdc38ada7ea0f7f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f7fd expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381333.787547:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787381333.787553:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ee5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd19486c-5291-4823-bb9c-f3a73416a496+4:5783:x1874205065884672:12345-0@lo:104: Request processed in 118us (5569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381333.787560:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787381333.787597:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787381333.787604:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd19486c-5291-4823-bb9c-f3a73416a496+3:5783:x1874205065884800:12345-0@lo:104: 00010000:00010000:1.0:1787381333.787611:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9a164166be00/0xbdc38ada7ea0f7cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f7d3 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381333.787663:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787381333.787669:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd19486c-5291-4823-bb9c-f3a73416a496+3:5783:x1874205065884800:12345-0@lo:104: Request processed in 66us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381333.787674:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1787381333.787823:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787381333.787830:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a1640031600/0xbdc38ada7ea0f7f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f7fd expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381333.787838:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1640031600 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:0.0:1787381333.787841:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a1640031600/0xbdc38ada7ea0f7f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xbdc38ada7ea0f7fd expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381333.787850:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a1640031600/0xbdc38ada7ea0f7f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xbdc38ada7ea0f7fd expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787381333.787858:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a1640031600/0xbdc38ada7ea0f7f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xbdc38ada7ea0f7fd expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787381333.787864:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787381333.787899:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a1640031600/0xbdc38ada7ea0f7f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f7fd expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381333.787906:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787381333.787925:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a1640031600/0xbdc38ada7ea0f7f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f7fd expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381333.787932:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a1640031600/0xbdc38ada7ea0f7f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f7fd expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381333.787947:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787381333.787950:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a164166be00/0xbdc38ada7ea0f7cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f7d3 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381333.787967:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a164166be00 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:0.0:1787381333.787969:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a164166be00/0xbdc38ada7ea0f7cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbdc38ada7ea0f7d3 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381333.787976:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a164166be00/0xbdc38ada7ea0f7cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbdc38ada7ea0f7d3 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787381333.787982:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a164166be00/0xbdc38ada7ea0f7cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbdc38ada7ea0f7d3 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787381333.787986:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787381333.788000:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a164166be00/0xbdc38ada7ea0f7cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f7d3 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381333.788029:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787381333.788035:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a164166be00/0xbdc38ada7ea0f7cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f7d3 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381333.788040:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a164166be00/0xbdc38ada7ea0f7cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f7d3 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381333.788051:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381333.788053:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381333.788054:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787381333.788075:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd19486c-5291-4823-bb9c-f3a73416a496:3310:1874205065885312:0@lo:103: 00000100:00100000:0.0:1787381333.788121:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381333.788154:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787381333.788161:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd19486c-5291-4823-bb9c-f3a73416a496:3310:1874205065885440:0@lo:103: 00000100:00100000:0.0:1787381333.788196:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381333.788224:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065885312 00000100:00100000:0.0:1787381333.788228:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065885312 00010000:00010000:0.0:1787381333.788247:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a1640031000/0xbdc38ada7ea0f7fd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f7f6 expref: 17 pid: 5785 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381333.788277:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065885440 00000100:00100000:0.0:1787381333.788280:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065885440 00010000:00010000:0.0:1787381333.788291:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a168216ca00/0xbdc38ada7ea0f7d3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f7cc expref: 18 pid: 5783 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381333.788304:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787381333.788310:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16461ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd19486c-5291-4823-bb9c-f3a73416a496+18:3310:x1874205065885312:12345-0@lo:103: 00010000:00010000:0.0:1787381333.788319:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787381333.788324:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a1640031000/0xbdc38ada7ea0f7fd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f7f6 expref: 18 pid: 5785 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381333.788334:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a1640031000/0xbdc38ada7ea0f7fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f7f6 expref: 18 pid: 5785 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381333.788350:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787381333.788376:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16461ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd19486c-5291-4823-bb9c-f3a73416a496+18:3310:x1874205065885312:12345-0@lo:103: Request processed in 66us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381333.788382:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787381333.788394:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787381333.788399:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16461edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd19486c-5291-4823-bb9c-f3a73416a496+17:3310:x1874205065885440:12345-0@lo:103: 00010000:00010000:0.0:1787381333.788405:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787381333.788409:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a168216ca00/0xbdc38ada7ea0f7d3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f7cc expref: 17 pid: 5783 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381333.788427:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a168216ca00/0xbdc38ada7ea0f7d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f7cc expref: 17 pid: 5783 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381333.788436:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787381333.788456:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16461edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd19486c-5291-4823-bb9c-f3a73416a496+17:3310:x1874205065885440:12345-0@lo:103: Request processed in 57us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381333.788462:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787381333.788611:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd19486c-5291-4823-bb9c-f3a73416a496:3310:1874205065885440:0@lo:103: 00000100:00100000:0.0:1787381333.788618:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd19486c-5291-4823-bb9c-f3a73416a496:3310:1874205065885312:0@lo:103: 00010000:00010000:3.0:1787381333.788706:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1640031000/0xbdc38ada7ea0f7fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbdc38ada7ea0f7f6 expref: 16 pid: 5785 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381333.788716:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5783:1874205065884672:0@lo:104: 00010000:00010000:3.0:1787381333.788725:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a168216ca00/0xbdc38ada7ea0f7d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbdc38ada7ea0f7cc expref: 15 pid: 5783 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381333.788733:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5783:1874205065884800:0@lo:104: 00010000:00010000:3.0:1787381333.789158:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787381333.789261:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381333.789293:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381333.789304:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065884928 00000100:00100000:2.0:1787381333.789307:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065884928 00000100:00100000:2.0:1787381333.789331:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065885056 00000100:00100000:2.0:1787381333.789333:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065885056 00000100:00100000:2.0:1787381333.789343:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065885184 00000100:00100000:2.0:1787381333.789345:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065885184 00000100:00100000:2.0:1787381333.789356:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787381333.789362:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+5:5783:x1874205065884928:12345-0@lo:104: 00010000:00010000:2.0:1787381333.789373:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9a164166b400/0xbdc38ada7ea0f7b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f7b7 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.789458:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787381333.789464:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+5:5783:x1874205065884928:12345-0@lo:104: Request processed in 103us (2200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381333.789471:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787381333.789616:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5783:1874205065884928:0@lo:104: 00000100:00100000:2.0:1787381333.789791:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787381333.789799:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+4:5783:x1874205065885056:12345-0@lo:104: 00010000:00010000:2.0:1787381333.789807:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9a16413a1600/0xbdc38ada7ea0f786 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f78d expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.789889:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787381333.789895:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+4:5783:x1874205065885056:12345-0@lo:104: Request processed in 98us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381333.789901:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787381333.789915:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787381333.789921:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+3:5783:x1874205065885184:12345-0@lo:104: 00010000:00010000:2.0:1787381333.789929:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9a16413a1000/0xbdc38ada7ea0f75c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f763 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.789970:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787381333.789976:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+3:5783:x1874205065885184:12345-0@lo:104: Request processed in 56us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381333.789982:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1787381333.790032:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787381333.790037:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a164166b400/0xbdc38ada7ea0f7b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f7b7 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.790044:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a164166b400 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:2.0:1787381333.790048:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a164166b400/0xbdc38ada7ea0f7b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbdc38ada7ea0f7b7 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.790055:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a164166b400/0xbdc38ada7ea0f7b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbdc38ada7ea0f7b7 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787381333.790062:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a164166b400/0xbdc38ada7ea0f7b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbdc38ada7ea0f7b7 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787381333.790067:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787381333.790097:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a164166b400/0xbdc38ada7ea0f7b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f7b7 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.790121:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787381333.790138:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a164166b400/0xbdc38ada7ea0f7b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f7b7 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.790145:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a164166b400/0xbdc38ada7ea0f7b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f7b7 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.790166:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787381333.790169:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a16413a1600/0xbdc38ada7ea0f786 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f78d expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.790174:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a1600 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:2.0:1787381333.790176:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a16413a1600/0xbdc38ada7ea0f786 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbdc38ada7ea0f78d expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.790182:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a16413a1600/0xbdc38ada7ea0f786 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbdc38ada7ea0f78d expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787381333.790188:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a16413a1600/0xbdc38ada7ea0f786 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbdc38ada7ea0f78d expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787381333.790192:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787381333.790205:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a16413a1600/0xbdc38ada7ea0f786 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f78d expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.790211:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787381333.790216:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a16413a1600/0xbdc38ada7ea0f786 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f78d expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.790222:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a16413a1600/0xbdc38ada7ea0f786 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f78d expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.790233:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787381333.790235:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a16413a1000/0xbdc38ada7ea0f75c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f763 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.790249:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a1000 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:2.0:1787381333.790252:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a16413a1000/0xbdc38ada7ea0f75c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbdc38ada7ea0f763 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.790258:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a16413a1000/0xbdc38ada7ea0f75c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbdc38ada7ea0f763 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787381333.790275:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a16413a1000/0xbdc38ada7ea0f75c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbdc38ada7ea0f763 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787381333.790280:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787381333.790294:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a16413a1000/0xbdc38ada7ea0f75c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f763 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.790299:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787381333.790313:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a16413a1000/0xbdc38ada7ea0f75c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f763 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.790319:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a16413a1000/0xbdc38ada7ea0f75c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f763 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.790332:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381333.790334:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381333.790335:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787381333.790348:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065885568:0@lo:103: 00000100:00100000:2.0:1787381333.790378:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381333.790411:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787381333.790435:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065885696:0@lo:103: 00000100:00100000:2.0:1787381333.790468:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381333.791902:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787381333.791920:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd19486c-5291-4823-bb9c-f3a73416a496:3311:1874205065885824:0@lo:103: 00000100:00100000:2.0:1787381333.791961:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381333.792000:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065885568 00000100:00100000:2.0:1787381333.792024:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065885568 00010000:00010000:2.0:1787381333.792049:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a16413a0a00/0xbdc38ada7ea0f7b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f7b0 expref: 15 pid: 5784 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381333.792068:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065885696 00000100:00100000:2.0:1787381333.792070:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065885696 00010000:00010000:2.0:1787381333.792081:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a164166b200/0xbdc38ada7ea0f78d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f786 expref: 16 pid: 5785 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381333.792091:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065885824 00000100:00100000:2.0:1787381333.792093:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065885824 00010000:00010000:2.0:1787381333.792102:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a1640031e00/0xbdc38ada7ea0f763 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f75c expref: 17 pid: 5785 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381333.792124:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787381333.792131:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd19486c-5291-4823-bb9c-f3a73416a496+17:3308:x1874205065885568:12345-0@lo:103: 00010000:00010000:2.0:1787381333.792143:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381333.792148:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a16413a0a00/0xbdc38ada7ea0f7b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f7b0 expref: 17 pid: 5784 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.792160:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a16413a0a00/0xbdc38ada7ea0f7b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f7b0 expref: 17 pid: 5784 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.792176:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a16413a0a00/0xbdc38ada7ea0f7b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbdc38ada7ea0f7b0 expref: 17 pid: 5784 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.792208:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787381333.792241:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd19486c-5291-4823-bb9c-f3a73416a496+16:3308:x1874205065885568:12345-0@lo:103: Request processed in 110us (1861us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381333.792248:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787381333.792276:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787381333.792283:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd19486c-5291-4823-bb9c-f3a73416a496+15:3308:x1874205065885696:12345-0@lo:103: 00010000:00010000:2.0:1787381333.792291:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381333.792295:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a164166b200/0xbdc38ada7ea0f78d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f786 expref: 15 pid: 5785 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.792303:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a164166b200/0xbdc38ada7ea0f78d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f786 expref: 15 pid: 5785 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.792312:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787381333.792333:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd19486c-5291-4823-bb9c-f3a73416a496+15:3308:x1874205065885696:12345-0@lo:103: Request processed in 51us (1864us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381333.792340:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787381333.792352:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787381333.792358:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd19486c-5291-4823-bb9c-f3a73416a496+14:3311:x1874205065885824:12345-0@lo:103: 00010000:00010000:2.0:1787381333.792364:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381333.792369:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a1640031e00/0xbdc38ada7ea0f763 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f75c expref: 14 pid: 5785 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.792377:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a1640031e00/0xbdc38ada7ea0f763 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f75c expref: 14 pid: 5785 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.792388:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a16413a1800/0xbdc38ada7ea0f812 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.792401:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a16413a1800/0xbdc38ada7ea0f812 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.792417:0:5776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a16413a1800/0xbdc38ada7ea0f812 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.792439:0:5776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a16413a1800/0xbdc38ada7ea0f812 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.792446:0:5776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a16413a1800/0xbdc38ada7ea0f812 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.792453:0:5776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a16413a1800/0xbdc38ada7ea0f812 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.792459:0:5776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a1800 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:2.0:1787381333.792463:0:5776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a16413a1800/0xbdc38ada7ea0f812 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.792471:0:5776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a16413a1800/0xbdc38ada7ea0f812 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381333.792704:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381333.794121:0:5776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a16413a1800/0xbdc38ada7ea0f812 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.794138:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787381333.794210:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd19486c-5291-4823-bb9c-f3a73416a496+14:3311:x1874205065885824:12345-0@lo:103: Request processed in 1849us (2245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381333.794218:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787381333.794369:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd19486c-5291-4823-bb9c-f3a73416a496:3311:1874205065885824:0@lo:103: 00000100:00100000:2.0:1787381333.794759:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065885696:0@lo:103: 00000100:00100000:2.0:1787381333.794788:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065885568:0@lo:103: 00010000:00010000:3.0:1787381333.805514:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a164166b200/0xbdc38ada7ea0f78d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbdc38ada7ea0f786 expref: 13 pid: 5785 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381333.805536:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5783:1874205065885056:0@lo:104: 00010000:00010000:3.0:1787381333.805564:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1640031e00/0xbdc38ada7ea0f763 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbdc38ada7ea0f75c expref: 12 pid: 5785 timeout: 341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381333.805574:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5783:1874205065885184:0@lo:104: 00010000:00010000:3.0:1787381333.805623:0:5783:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a16413a1800/0xbdc38ada7ea0f812 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381333.805633:0:5783:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a16413a1800/0xbdc38ada7ea0f812 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381333.805639:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a16413a1800/0xbdc38ada7ea0f812 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381333.805645:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a16413a1800/0xbdc38ada7ea0f812 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787381333.805659:0:5783:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:2.0:1787381333.900775:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787381333.934890:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+11:7464:x1874205065884544:12345-0@lo:253: Request processed in 183076us (183601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381333.934905:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787381333.934992:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461ed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:7464:1874205065884544:0@lo:253: 10000000:01000000:0.0:1787381333.935038:0:7464:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787381333.935041:0:7464:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787381333.935043:0:7464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787381333.935044:0:7464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787381333.935045:0:7464:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1787381333.935047:0:7464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787381333.935048:0:7464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787381333.935050:0:7464:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787381333.935051:0:7464:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787381333.935053:0:7464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787381333.935055:0:7464:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787381333.935283:0:7464:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a16436a3000 from lustre-OST0001 10000000:01000000:2.0:1787381333.935310:0:7464:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787381333.935313:0:7464:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787381333.935320:0:7464:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a1646130000 local copy 10000000:01000000:2.0:1787381333.935324:0:7464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787381333.935439:0:7464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a164166b400/0xbdc38ada7ea0f819 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.935451:0:7464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.122@tcp lock: ffff9a164166b400/0xbdc38ada7ea0f819 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.935461:0:7464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a164166b400/0xbdc38ada7ea0f819 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381333.935547:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:7464:1874205065885952:0@lo:101: 00000100:00100000:2.0:1787381333.935588:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381333.939670:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f94a480 going to sleep for 11 seconds 00000100:00100000:0.0:1787381333.943699:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065885952 00000100:00100000:0.0:1787381333.943715:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065885952 00000100:00100000:1.0:1787381333.943837:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787381333.943848:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+11:7464:x1874205065885952:12345-0@lo:101: 00010000:00010000:1.0:1787381333.943863:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381333.943884:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a16413a1400/0xbdc38ada7ea0f820 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0f819 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381333.943918:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a16413a1400/0xbdc38ada7ea0f820 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f819 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381333.943929:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a16413a1400/0xbdc38ada7ea0f820 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f819 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381333.943938:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16413a1400, rc 0) 00000100:00100000:1.0:1787381333.944045:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+12:7464:x1874205065885952:12345-0@lo:101: Request processed in 199us (8455us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381333.944051:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787381333.944256:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:7464:1874205065885952:0@lo:101: 00010000:00010000:2.0:1787381333.944274:0:7464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a164166b400/0xbdc38ada7ea0f819 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xbdc38ada7ea0f820 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.944283:0:7464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a164166b400/0xbdc38ada7ea0f819 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbdc38ada7ea0f820 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381333.944409:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:7464:1874205065886080:0@lo:501: 00000100:00100000:2.0:1787381333.944445:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381333.944496:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f94a480 going to sleep for 11 seconds 00000100:00100000:3.0:1787381333.944565:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065886080 00000100:00100000:3.0:1787381333.944570:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065886080 00000100:00100000:3.0:1787381333.944605:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787381333.944612:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+12:7464:x1874205065886080:12345-0@lo:501: 00000100:00100000:3.0:1787381333.944824:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+12:7464:x1874205065886080:12345-0@lo:501: Request processed in 211us (377us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787381333.944832:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787381333.945309:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:7464:1874205065886080:0@lo:501: 10000000:01000000:2.0:1787381333.945323:0:7464:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.122@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787381333.945352:0:7464:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.122@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787381333.945358:0:7464:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a164166b400/0xbdc38ada7ea0f819 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xbdc38ada7ea0f820 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.945367:0:7464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a164166b400/0xbdc38ada7ea0f819 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbdc38ada7ea0f820 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.945374:0:7464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9a164166b400/0xbdc38ada7ea0f819 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xbdc38ada7ea0f820 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.945398:0:7464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787381333.945421:0:7464:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a16436a3000 10000000:01000000:2.0:1787381333.945425:0:7464:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787381333.945431:0:7464:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787381333.945433:0:7464:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787381333.945437:0:7464:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787381333.945440:0:7464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787381333.945460:0:7464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a164166a000/0xbdc38ada7ea0f827 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.945468:0:7464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a164166a000/0xbdc38ada7ea0f827 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381333.945477:0:7464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a164166a000/0xbdc38ada7ea0f827 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381333.945490:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:7464:1874205065886208:0@lo:101: 00000100:00100000:2.0:1787381333.945760:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381333.945793:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f94ae40 going to sleep for 11 seconds 00010000:00010000:0.0:1787381333.945913:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787381333.945920:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a164166b400/0xbdc38ada7ea0f819 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xbdc38ada7ea0f820 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381333.945938:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a164166b400 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:0.0:1787381333.945941:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a164166b400/0xbdc38ada7ea0f819 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xbdc38ada7ea0f820 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381333.945950:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a164166b400/0xbdc38ada7ea0f819 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xbdc38ada7ea0f820 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787381333.945956:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a164166b400/0xbdc38ada7ea0f819 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xbdc38ada7ea0f820 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787381333.945961:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787381333.945979:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a164166b400/0xbdc38ada7ea0f819 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbdc38ada7ea0f820 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381333.945984:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787381333.946037:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a164166b400/0xbdc38ada7ea0f819 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbdc38ada7ea0f820 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381333.946043:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a164166b400/0xbdc38ada7ea0f819 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xbdc38ada7ea0f820 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381333.946054:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381333.946056:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381333.946057:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787381333.946171:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065886208 00000100:00100000:1.0:1787381333.946177:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065886208 00000100:00100000:3.0:1787381333.946195:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787381333.946205:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd19486c-5291-4823-bb9c-f3a73416a496:3310:1874205065886336:0@lo:103: 00000100:00100000:1.0:1787381333.946220:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787381333.946228:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+12:7464:x1874205065886208:12345-0@lo:101: 00000100:00100000:3.0:1787381333.946236:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787381333.946238:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381333.946249:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a16413a1800/0xbdc38ada7ea0f82e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0f827 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381333.946292:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a16413a1800/0xbdc38ada7ea0f82e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f827 expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381333.946302:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a16413a1800/0xbdc38ada7ea0f82e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f827 expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381333.946310:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16413a1800, rc 0) 00000100:00100000:1.0:1787381333.946427:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+13:7464:x1874205065886208:12345-0@lo:101: Request processed in 200us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381333.946434:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787381333.946462:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065886336 00000100:00100000:1.0:1787381333.946466:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065886336 00000100:00100000:1.0:1787381333.946492:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787381333.946498:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd19486c-5291-4823-bb9c-f3a73416a496+13:3310:x1874205065886336:12345-0@lo:103: 00010000:00010000:1.0:1787381333.946506:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381333.946517:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a16413a1400/0xbdc38ada7ea0f820 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbdc38ada7ea0f819 expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381333.946573:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787381333.946574:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:7464:1874205065886208:0@lo:101: 00010000:00010000:3.0:1787381333.946586:0:7464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a164166a000/0xbdc38ada7ea0f827 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f82e expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381333.946600:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd19486c-5291-4823-bb9c-f3a73416a496+12:3310:x1874205065886336:12345-0@lo:103: Request processed in 102us (361us total) trans 0 rc 0/0 00010000:00010000:3.0:1787381333.946601:0:7464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a164166a000/0xbdc38ada7ea0f827 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f82e expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381333.946606:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787381333.946631:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd19486c-5291-4823-bb9c-f3a73416a496:3310:1874205065886336:0@lo:103: 00000100:00100000:3.0:1787381333.946677:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:7464:1874205065886464:0@lo:501: 00000100:00100000:3.0:1787381333.946702:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381333.946723:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a166fa3e240 going to sleep for 11 seconds 00000100:00100000:0.0:1787381333.946937:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065886464 00000100:00100000:0.0:1787381333.946942:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065886464 00000100:00100000:0.0:1787381333.947055:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787381333.947063:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+12:7464:x1874205065886464:12345-0@lo:501: 00000100:00100000:0.0:1787381333.947305:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+12:7464:x1874205065886464:12345-0@lo:501: Request processed in 243us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381333.947318:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787381333.947347:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:7464:1874205065886464:0@lo:501: 00000100:00100000:0.0:1787381333.947376:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:7464:1874205065886592:0@lo:503: 00000100:00100000:0.0:1787381333.947413:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381333.947430:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f5b3480 going to sleep for 11 seconds 00000100:00100000:0.0:1787381333.947449:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065886592 00000100:00100000:0.0:1787381333.947453:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065886592 00000100:00100000:0.0:1787381333.947470:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787381333.947475:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+12:7464:x1874205065886592:12345-0@lo:503: 00000100:00100000:0.0:1787381333.947621:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+12:7464:x1874205065886592:12345-0@lo:503: Request processed in 144us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381333.947628:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787381333.947663:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:7464:1874205065886592:0@lo:503: 00000040:00080000:0.0:1787381333.950431:0:7464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787381333.950855:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:7464:1874205065886720:0@lo:502: 00000100:00100000:0.0:1787381333.950932:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381333.950978:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f5b3480 going to sleep for 11 seconds 00000100:00100000:1.0:1787381333.951092:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065886720 00000100:00100000:1.0:1787381333.951118:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065886720 00000100:00100000:1.0:1787381333.951210:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787381333.951219:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+12:7464:x1874205065886720:12345-0@lo:502: 00000100:00100000:1.0:1787381333.951430:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+12:7464:x1874205065886720:12345-0@lo:502: Request processed in 211us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381333.951437:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787381333.951605:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:7464:1874205065886720:0@lo:502: 00000040:00080000:0.0:1787381333.951855:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787381333.951903:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1787381333.951935:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1787381333.951980:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1787381333.952035:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1787381333.952069:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1787381333.952095:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:7464:1874205065886848:0@lo:502: 00000100:00100000:0.0:1787381333.952153:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381333.952900:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f5b3480 going to sleep for 11 seconds 00000100:00100000:3.0:1787381333.952951:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065886848 00000100:00100000:3.0:1787381333.952958:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065886848 00000100:00100000:3.0:1787381333.952993:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787381333.953000:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+12:7464:x1874205065886848:12345-0@lo:502: 00000100:00100000:3.0:1787381333.953215:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+12:7464:x1874205065886848:12345-0@lo:502: Request processed in 214us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381333.953222:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787381333.956282:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:7464:1874205065886848:0@lo:502: 00000040:00080000:2.0:1787381333.956480:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787381333.956495:0:7464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1787381333.960666:0:7472:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787381333.960678:0:7472:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1787381333.960685:0:7472:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787381333.960687:0:7472:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787381333.960693:0:7472:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787381333.960707:0:7472:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9a167b5719c0) 00000020:00000080:2.0:1787381333.960729:0:7472:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787381333.960736:0:7472:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787381333.961157:0:7472:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a16436a3000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1787381333.961168:0:7472:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787381333.961175:0:7472:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbdc38ada7ea0f83c 00010000:00010000:3.0:1787381333.975748:0:7472:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1787381333.976206:0:7472:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1787381333.985584:0:7472:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787381333.985853:0:7472:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1787381334.003961:0:7472:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1787381334.004551:0:7472:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1787381334.016830:0:7472:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787381334.016843:0:7472:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787381334.016850:0:7472:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787381334.016852:0:7472:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787381334.016856:0:7472:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787381334.016861:0:7472:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787381334.016862:0:7472:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787381334.016865:0:7472:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787381334.016867:0:7472:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787381334.016922:0:7472:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787381334.016926:0:7472:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787381334.016927:0:7472:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787381334.016931:0:7472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787381334.017045:0:7464:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1787381334.017070:0:7464:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787381334.017085:0:7464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a164166a000/0xbdc38ada7ea0f827 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f82e expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381334.017096:0:7464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a164166a000/0xbdc38ada7ea0f827 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f82e expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787381334.017104:0:7464:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a16436a3000 from 1 10000000:01000000:2.0:1787381334.017116:0:7464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787381334.017151:0:7464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a164166bc00/0xbdc38ada7ea0f843 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381334.017159:0:7464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a164166bc00/0xbdc38ada7ea0f843 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381334.017179:0:7464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a164166bc00/0xbdc38ada7ea0f843 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381334.017199:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:7464:1874205065886976:0@lo:101: 00000100:00100000:2.0:1787381334.017259:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381334.017306:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f94a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787381334.019051:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065886976 00000100:00100000:3.0:1787381334.019073:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065886976 00000100:00100000:3.0:1787381334.019139:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787381334.019149:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+12:7464:x1874205065886976:12345-0@lo:101: 00010000:00010000:3.0:1787381334.019164:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381334.019179:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a168216ca00/0xbdc38ada7ea0f84a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0f843 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381334.019203:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a168216ca00/0xbdc38ada7ea0f84a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f843 expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381334.019230:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a168216ca00/0xbdc38ada7ea0f84a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f843 expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381334.019238:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a168216ca00, rc 0) 00000100:00100000:3.0:1787381334.019314:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+13:7464:x1874205065886976:12345-0@lo:101: Request processed in 166us (2053us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381334.019320:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787381334.019332:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:7464:1874205065886976:0@lo:101: 00010000:00010000:2.0:1787381334.019347:0:7464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a164166bc00/0xbdc38ada7ea0f843 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f84a expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381334.019371:0:7464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a164166bc00/0xbdc38ada7ea0f843 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f84a expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381334.019490:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:7464:1874205065887104:0@lo:501: 00000100:00100000:2.0:1787381334.019521:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381334.019553:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f94a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787381334.019617:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065887104 00000100:00100000:0.0:1787381334.019622:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065887104 00000100:00100000:0.0:1787381334.019655:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787381334.019662:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+13:7464:x1874205065887104:12345-0@lo:501: 00000100:00100000:0.0:1787381334.019866:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+13:7464:x1874205065887104:12345-0@lo:501: Request processed in 204us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381334.019873:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787381334.019899:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:7464:1874205065887104:0@lo:501: 00000100:00100000:0.0:1787381334.019925:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461eed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:7464:1874205065887232:0@lo:503: 00000100:00100000:0.0:1787381334.019959:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381334.019968:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f5b3480 going to sleep for 11 seconds 00000100:00100000:0.0:1787381334.019987:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065887232 00000100:00100000:0.0:1787381334.019995:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065887232 00000100:00100000:0.0:1787381334.020031:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787381334.020037:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+13:7464:x1874205065887232:12345-0@lo:503: 00000100:00100000:0.0:1787381334.023453:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+13:7464:x1874205065887232:12345-0@lo:503: Request processed in 3407us (3485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381334.023467:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787381334.023529:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461eed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:7464:1874205065887232:0@lo:503: 00000040:00080000:0.0:1787381334.023816:0:7464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787381334.023900:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461eed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:7464:1874205065887360:0@lo:502: 00000100:00100000:0.0:1787381334.023942:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381334.023980:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1665a6b540 going to sleep for 11 seconds 00000100:00100000:0.0:1787381334.024021:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065887360 00000100:00100000:0.0:1787381334.024027:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065887360 00000100:00100000:0.0:1787381334.024054:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787381334.024062:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+13:7464:x1874205065887360:12345-0@lo:502: 00000100:00100000:0.0:1787381334.024250:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+13:7464:x1874205065887360:12345-0@lo:502: Request processed in 188us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381334.024257:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787381334.028970:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461eed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:7464:1874205065887360:0@lo:502: 00000040:00080000:0.0:1787381334.029879:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787381334.029944:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787381334.029983:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461eed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:7464:1874205065887488:0@lo:502: 00000100:00100000:0.0:1787381334.031183:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381334.031361:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1665a6b540 going to sleep for 11 seconds 00000100:00100000:0.0:1787381334.031398:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065887488 00000100:00100000:0.0:1787381334.031407:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065887488 00000100:00100000:1.0:1787381334.037684:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787381334.037701:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+13:7464:x1874205065887488:12345-0@lo:502: 00000100:00100000:1.0:1787381334.037961:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+13:7464:x1874205065887488:12345-0@lo:502: Request processed in 265us (6780us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381334.037969:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787381334.038480:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461eed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:7464:1874205065887488:0@lo:502: 00000040:00080000:2.0:1787381334.038641:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787381334.038669:0:7464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787381334.039753:0:7476:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787381334.039771:0:7476:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787381334.039773:0:7476:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787381334.039781:0:7476:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a16436a3000 00000020:00000080:0.0:1787381334.039783:0:7476:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787381334.039809:0:7476:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787381334.039813:0:7476:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787381334.039814:0:7476:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787381334.039817:0:7476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787381334.039965:0:7464:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787381334.039984:0:7464:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787381334.040037:0:7464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a164166bc00/0xbdc38ada7ea0f843 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f84a expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381334.040048:0:7464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a164166bc00/0xbdc38ada7ea0f843 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f84a expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787381334.040383:0:7464:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787381334.040386:0:7464:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a16436a3000 10000000:01000000:2.0:1787381334.040389:0:7464:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a16436a3000 10000000:01000000:2.0:1787381334.040393:0:7464:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787381334.040399:0:7464:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a16436a3000 from 1 10000000:01000000:2.0:1787381334.040402:0:7464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787381334.040433:0:7464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a164166ba00/0xbdc38ada7ea0f851 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381334.040442:0:7464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a164166ba00/0xbdc38ada7ea0f851 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381334.040451:0:7464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a164166ba00/0xbdc38ada7ea0f851 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381334.040472:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:7464:1874205065887616:0@lo:101: 00000100:00100000:2.0:1787381334.040622:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381334.042517:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f94a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787381334.043202:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065887616 00000100:00100000:1.0:1787381334.043212:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065887616 00000100:00100000:1.0:1787381334.043380:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787381334.043390:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+13:7464:x1874205065887616:12345-0@lo:101: 00010000:00010000:1.0:1787381334.043406:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381334.043424:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a16413a1400/0xbdc38ada7ea0f858 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0f851 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381334.043750:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a16413a1400/0xbdc38ada7ea0f858 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f851 expref: 14 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381334.043760:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a16413a1400/0xbdc38ada7ea0f858 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f851 expref: 14 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381334.043770:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16413a1400, rc 0) 00000100:00100000:1.0:1787381334.043846:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+14:7464:x1874205065887616:12345-0@lo:101: Request processed in 458us (3322us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381334.043853:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787381334.043954:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:7464:1874205065887616:0@lo:101: 00010000:00010000:0.0:1787381334.043970:0:7464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a164166ba00/0xbdc38ada7ea0f851 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f858 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381334.043979:0:7464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a164166ba00/0xbdc38ada7ea0f851 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f858 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381334.044641:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461eca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:7464:1874205065887744:0@lo:501: 00000100:00100000:0.0:1787381334.044750:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381334.044822:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1665a6b480 going to sleep for 11 seconds 00000100:00100000:3.0:1787381334.050578:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065887744 00000100:00100000:3.0:1787381334.050592:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065887744 00000100:00100000:3.0:1787381334.050658:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787381334.050669:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646169c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+14:7464:x1874205065887744:12345-0@lo:501: 00000100:00100000:3.0:1787381334.050974:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646169c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+14:7464:x1874205065887744:12345-0@lo:501: Request processed in 306us (6222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381334.050981:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787381334.051245:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461eca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:7464:1874205065887744:0@lo:501: 00000100:00100000:1.0:1787381334.051313:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:7464:1874205065887872:0@lo:503: 00000100:00100000:1.0:1787381334.051357:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381334.051399:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1646dc39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787381334.051536:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065887872 00000100:00100000:0.0:1787381334.051541:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065887872 00000100:00100000:0.0:1787381334.051569:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787381334.051577:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+14:7464:x1874205065887872:12345-0@lo:503: 00000100:00100000:0.0:1787381334.051739:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+14:7464:x1874205065887872:12345-0@lo:503: Request processed in 163us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381334.051746:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787381334.051790:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:7464:1874205065887872:0@lo:503: 00000040:00080000:0.0:1787381334.052120:0:7464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787381334.052181:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:7464:1874205065888000:0@lo:502: 00000100:00100000:0.0:1787381334.052221:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381334.052246:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065888000 00000100:00100000:0.0:1787381334.052250:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065888000 00000100:00100000:0.0:1787381334.052453:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787381334.052462:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+14:7464:x1874205065888000:12345-0@lo:502: 00000100:00100000:0.0:1787381334.052629:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+14:7464:x1874205065888000:12345-0@lo:502: Request processed in 167us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381334.052636:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787381334.058520:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1665a6b480 going to sleep for 11 seconds 00000100:00100000:2.0:1787381334.058567:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461ef480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:7464:1874205065888000:0@lo:502: 00000040:00080000:2.0:1787381334.058928:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787381334.058990:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787381334.064593:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787381334.065385:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787381334.065437:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787381334.065490:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787381334.065527:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787381334.065565:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787381334.065612:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787381334.067139:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787381334.067209:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787381334.067577:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787381334.067626:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787381334.067878:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787381334.067954:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787381334.067997:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787381334.068267:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787381334.068333:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787381334.068372:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787381334.068408:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787381334.068458:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787381334.068508:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787381334.068544:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787381334.068597:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787381334.068634:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787381334.068672:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787381334.068722:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787381334.068776:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1787381334.068813:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787381334.068864:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1787381334.068900:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1787381334.069225:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1787381334.069264:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1787381334.069310:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1787381334.069346:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1787381334.069409:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1787381334.069449:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1787381334.069493:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:7464:1874205065888128:0@lo:502: 00000100:00100000:2.0:1787381334.069567:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381334.069615:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f94a780 going to sleep for 11 seconds 00000100:00100000:0.0:1787381334.069739:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065888128 00000100:00100000:0.0:1787381334.069748:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065888128 00000100:00100000:0.0:1787381334.069798:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787381334.069807:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+14:7464:x1874205065888128:12345-0@lo:502: 00000100:00100000:0.0:1787381334.070041:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+14:7464:x1874205065888128:12345-0@lo:502: Request processed in 233us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381334.070048:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787381334.070188:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:7464:1874205065888128:0@lo:502: 00000040:00080000:2.0:1787381334.070259:0:7464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1787381334.070268:0:7464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1787381334.073486:0:7477:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787381334.073502:0:7477:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9a16483d0000) 00000020:00000080:3.0:1787381334.073525:0:7477:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1787381334.073703:0:7477:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a16436a3000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787381334.073708:0:7477:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a16436a3000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787381334.073710:0:7477:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a16436a3000 3 00010000:00080000:3.0:1787381334.073737:0:7477:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a1675362000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.122@tcp at head 00010000:00010000:1.0:1787381334.084906:0:7477:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1787381334.085173:0:7477:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787381334.085226:0:7477:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787381334.085239:0:7477:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xbdc38ada7ea0f866 00000100:00080000:1.0:1787381334.085249:0:7477:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787381334.085255:0:7477:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a1675362000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:1.0:1787381334.085435:0:7477:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a167a33e680 x1874205065888256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787381334.085456:0:7477:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787381334.085767:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1874205065888256:0@lo:38: 00000100:00100000:3.0:1787381334.085831:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381334.085987:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065888256 00000100:00100000:1.0:1787381334.085993:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065888256 00000100:00100000:1.0:1787381334.086044:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787381334.086051:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1874205065888256:12345-0@lo:38: 00010000:00080000:1.0:1787381334.086082:0:5790:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:1.0:1787381334.086138:0:5790:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xbdc38ada7ea0f86d 00000004:00100000:1.0:1787381334.086154:0:5790:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787381334.086183:0:5790:0:(import.c:65:import_set_state_nolock()) ffff9a16436a1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787381334.086245:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874205065888256:12345-0@lo:38: Request processed in 193us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381334.086253:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787381334.086371:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a167a33e680 x1874205065888256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787381344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787381334.086382:0:3307:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787381334.086389:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1787381334.086396:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787381334.086400:0:3307:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787381334.086402:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9a1675362000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787381334.086409:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1874205065888256:0@lo:38: 00000040:00080000:1.0:1787381334.090447:0:7477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1787381334.090545:0:7464:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1787381334.090568:0:7464:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787381334.090592:0:7464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a164166ba00/0xbdc38ada7ea0f851 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f858 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381334.090615:0:7464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a164166ba00/0xbdc38ada7ea0f851 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f858 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787381334.090676:0:7464:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787381334.090678:0:7464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787381334.090679:0:7464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787381334.090680:0:7464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787381334.090682:0:7464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787381334.090683:0:7464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787381334.090685:0:7464:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787381334.090686:0:7464:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787381334.090688:0:7464:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787381334.090690:0:7464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787381334.090691:0:7464:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787381334.090695:0:7464:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1787381334.090697:0:7464:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787381334.090698:0:7464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787381334.090699:0:7464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787381334.090700:0:7464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787381334.090701:0:7464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787381334.090702:0:7464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787381334.090703:0:7464:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787381334.090704:0:7464:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787381334.090705:0:7464:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787381334.090706:0:7464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787381334.090707:0:7464:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787381334.090731:0:7464:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787381334.090751:0:7464:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:7464:1874205065888384:0@lo:253: 00000100:00100000:1.0:1787381334.090816:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381334.090851:0:7464:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1646dc3240 going to sleep for 11 seconds 00000100:00100000:1.0:1787381334.090903:0:7479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33c380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7479:1874205065888512:0@lo:901: 00000100:00100000:1.0:1787381334.090951:0:7479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381334.090970:0:7479:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1646dc3300 going to sleep for 11 seconds 00000100:00100000:0.0:1787381334.091818:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787381334.091832:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874205065888640:0@lo:400: 00000100:00100000:0.0:1787381334.091870:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381334.091907:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065888640 00000100:00100000:0.0:1787381334.091914:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065888640 00000100:00100000:0.0:1787381334.091955:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787381334.091964:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16461ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874205065888640:12345-0@lo:400: 00000100:00100000:0.0:1787381334.092034:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16461ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874205065888640:12345-0@lo:400: Request processed in 70us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381334.092041:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1787381334.092094:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a16461ef800 x1874205065888640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787381350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381334.092138:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874205065888640:0@lo:400: 00000100:00100000:0.0:1787381334.092202:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065888896:0@lo:400: 00000100:00100000:2.0:1787381334.092226:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1874205065888768:0@lo:400: 00000100:00100000:0.0:1787381334.092235:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381334.092266:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381334.092465:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065888896 00000100:00100000:0.0:1787381334.092470:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065888896 00000100:00100000:0.0:1787381334.092520:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787381334.092528:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16461ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065888896:12345-0@lo:400: 00000100:00100000:0.0:1787381334.092567:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16461ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065888896:12345-0@lo:400: Request processed in 40us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381334.092574:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787381334.092589:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065888768 00000100:00100000:0.0:1787381334.092593:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065888768 00000100:00100000:0.0:1787381334.092616:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787381334.092623:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874205065888768:12345-0@lo:400: 00000100:00100000:0.0:1787381334.092786:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874205065888768:12345-0@lo:400: Request processed in 163us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381334.092794:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1787381334.092821:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a16461ec000 x1874205065888896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787381350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381334.092831:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065888896:0@lo:400: 00000100:00080000:2.0:1787381334.093162:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787381334.093176:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787381334.093782:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a16461ef800 x1874205065888768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787381350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381334.093803:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1874205065888768:0@lo:400: 00000100:00100000:2.0:1787381334.094188:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065888384 00000100:00100000:2.0:1787381334.094195:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065888384 00000100:00100000:3.0:1787381334.094215:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065888512 00000100:00100000:3.0:1787381334.094222:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065888512 00000100:00100000:2.0:1787381334.094242:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1787381334.094252:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+14:7464:x1874205065888384:12345-0@lo:253: 20000000:01000000:2.0:1787381334.094284:0:5785:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787381334.094298:0:5785:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1787381334.095563:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787381334.095576:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a33d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7479:x1874205065888512:12345-0@lo:901: 00000100:00100000:3.0:1787381334.095968:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a33d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7479:x1874205065888512:12345-0@lo:901: Request processed in 394us (5014us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381334.095976:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787381334.096095:0:7479:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a167a33c380 x1874205065888512/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787381350 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787381334.096120:0:7479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33c380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7479:1874205065888512:0@lo:901: 00000100:00080000:1.0:1787381334.099394:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:3.0:1787381334.142509:0:5785:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787381334.142528:0:5785:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787381334.142679:0:5806:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787381334.142684:0:5806:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787381334.142705:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a1640031600/0xbdc38ada7ea0f874 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381334.142722:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a168216d200/0xbdc38ada7ea0f7c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f7be expref: 14 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381334.142744:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a1640031600/0xbdc38ada7ea0f874 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381334.142850:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a168216d200/0xbdc38ada7ea0f7c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbdc38ada7ea0f7be expref: 14 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381334.142864:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a168216d200/0xbdc38ada7ea0f7c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f7be expref: 14 pid: 5783 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381334.142877:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461ec000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5806:1874205065889024:0@lo:104: 00000100:00100000:1.0:1787381334.149096:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381334.149169:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1674d983c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787381334.149261:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065889024 00000100:00100000:2.0:1787381334.149271:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065889024 00000100:00100000:2.0:1787381334.149325:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787381334.149334:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a33ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+3:5806:x1874205065889024:12345-0@lo:104: 00010000:00010000:2.0:1787381334.149349:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9a168216c800/0xbdc38ada7ea0f7be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f7c5 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381334.149413:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787381334.149419:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a33ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+3:5806:x1874205065889024:12345-0@lo:104: Request processed in 87us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381334.149425:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1787381334.149444:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787381334.149449:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a168216c800/0xbdc38ada7ea0f7be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f7c5 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381334.149457:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a168216c800 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:2.0:1787381334.149461:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a168216c800/0xbdc38ada7ea0f7be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbdc38ada7ea0f7c5 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381334.149469:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a168216c800/0xbdc38ada7ea0f7be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbdc38ada7ea0f7c5 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787381334.149476:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a168216c800/0xbdc38ada7ea0f7be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbdc38ada7ea0f7c5 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787381334.149495:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787381334.149529:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a168216c800/0xbdc38ada7ea0f7be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f7c5 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381334.149535:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787381334.149553:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a168216c800/0xbdc38ada7ea0f7be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f7c5 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381334.149560:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a168216c800/0xbdc38ada7ea0f7be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f7c5 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381334.149579:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381334.149581:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381334.149583:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787381334.149649:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461ec000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5806:1874205065889024:0@lo:104: 00010000:00010000:3.0:1787381334.149670:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a1640031600/0xbdc38ada7ea0f874 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381334.150994:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd19486c-5291-4823-bb9c-f3a73416a496:3311:1874205065889152:0@lo:103: 00000100:00100000:0.0:1787381334.154446:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381334.163895:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065889152 00000100:00100000:2.0:1787381334.163909:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065889152 00010000:00010000:2.0:1787381334.163953:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a168216d200/0xbdc38ada7ea0f7c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f7be expref: 15 pid: 5783 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381334.163988:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787381334.163997:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166d05f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd19486c-5291-4823-bb9c-f3a73416a496+15:3311:x1874205065889152:12345-0@lo:103: 00010000:00010000:2.0:1787381334.164030:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381334.164036:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a168216d200/0xbdc38ada7ea0f7c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f7be expref: 15 pid: 5783 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381334.164047:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a168216d200/0xbdc38ada7ea0f7c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f7be expref: 15 pid: 5783 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381334.164063:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a168216d200/0xbdc38ada7ea0f7c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbdc38ada7ea0f7be expref: 15 pid: 5783 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381334.164092:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a1640031600/0xbdc38ada7ea0f874 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381334.164099:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1640031600/0xbdc38ada7ea0f874 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787381334.164128:0:5777:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.021444286s 00010000:00010000:2.0:1787381334.164133:0:5777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a1640031600/0xbdc38ada7ea0f874 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381334.164139:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a1640031600/0xbdc38ada7ea0f874 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381334.164145:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a1640031600/0xbdc38ada7ea0f874 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381334.164151:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a1640031600/0xbdc38ada7ea0f874 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381334.164157:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1640031600 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:2.0:1787381334.164161:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a1640031600/0xbdc38ada7ea0f874 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381334.164167:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a1640031600/0xbdc38ada7ea0f874 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381334.164184:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a1640031600/0xbdc38ada7ea0f874 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381334.164194:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787381334.164261:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166d05f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd19486c-5291-4823-bb9c-f3a73416a496+14:3311:x1874205065889152:12345-0@lo:103: Request processed in 265us (9821us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381334.164280:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1787381334.164335:0:5806:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a1640031600/0xbdc38ada7ea0f874 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381334.164343:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a1640031600/0xbdc38ada7ea0f874 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381334.164349:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1640031600/0xbdc38ada7ea0f874 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381334.167535:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd19486c-5291-4823-bb9c-f3a73416a496:3311:1874205065889152:0@lo:103: 00000100:00100000:0.0:1787381334.184183:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+13:7464:x1874205065888384:12345-0@lo:253: Request processed in 89924us (93358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381334.184196:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787381334.184299:0:7464:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cd19486c-5291-4823-bb9c-f3a73416a496:7464:1874205065888384:0@lo:253: 10000000:01000000:1.0:1787381334.184311:0:7464:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787381334.184314:0:7464:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787381334.184316:0:7464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787381334.184317:0:7464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787381334.184319:0:7464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787381334.184320:0:7464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787381334.184322:0:7464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787381334.184323:0:7464:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787381334.184324:0:7464:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787381334.184326:0:7464:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787381334.184327:0:7464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787381334.184329:0:7464:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787381334.184340:0:7464:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787381334.187544:0:7464:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787381334.187706:0:7464:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787381334.187888:0:7464:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787381334.193211:0:7464:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787381334.193544:0:7464:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787381334.193821:0:7464:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787381334.196625:0:7464:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787381334.459793:0:7464:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787381334.459800:0:7464:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787381334.459830:0:7464:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787381334.459883:0:7464:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.122@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787381334.459963:0:7464:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787381334.459989:0:7464:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1787381334.932936:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787381335.379146:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065889280:0@lo:13: 00000100:00100000:1.0:1787381335.379227:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381335.379337:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065889280 00000100:00100000:2.0:1787381335.379344:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065889280 00000100:00100000:2.0:1787381335.379396:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787381335.379406:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a33d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065889280:12345-0@lo:13: 00002000:00000024:2.0:1787381335.379440:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787381335.379495:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a33d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065889280:12345-0@lo:13: Request processed in 90us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381335.379502:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787381335.379597:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a6f7100 x1874205065889280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381351 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381335.379614:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065889280:0@lo:13: 00010000:00010000:3.0:1787381335.957924:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381336.973683:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381338.003514:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381339.024721:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787381339.468194:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065889792:0@lo:400: 00000100:00100000:0.0:1787381339.468278:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381339.468340:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787381339.468347:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065889408:0@lo:400: 00000100:00100000:0.0:1787381339.468388:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381339.468414:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1874205065889920:0@lo:400: 00000100:00100000:0.0:1787381339.468441:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381339.468488:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874205065889536:0@lo:400: 00000100:00100000:0.0:1787381339.468522:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381339.468540:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787381339.468545:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1874205065889664:0@lo:400: 00000100:00100000:0.0:1787381339.468580:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381339.468613:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065889792 00000100:00100000:0.0:1787381339.468620:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065889792 00000100:00100000:0.0:1787381339.468670:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787381339.468679:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16461edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065889792:12345-0@lo:400: 00000100:00100000:0.0:1787381339.468728:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16461edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065889792:12345-0@lo:400: Request processed in 50us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381339.468736:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787381339.468757:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065889408 00000100:00100000:0.0:1787381339.468761:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065889408 00000100:00100000:0.0:1787381339.468800:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787381339.468806:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+13:3308:x1874205065889408:12345-0@lo:400: 00000100:00100000:0.0:1787381339.468836:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+13:3308:x1874205065889408:12345-0@lo:400: Request processed in 30us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381339.468842:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787381339.468869:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065889920 00000100:00100000:0.0:1787381339.468873:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065889920 00000100:00100000:0.0:1787381339.468892:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065889536 00000100:00100000:0.0:1787381339.468895:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065889536 00000100:00100000:0.0:1787381339.468906:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065889664 00000100:00100000:0.0:1787381339.468908:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065889664 00000100:00100000:0.0:1787381339.468920:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787381339.468926:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16461ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874205065889920:12345-0@lo:400: 00000100:00100000:0.0:1787381339.468956:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16461ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874205065889920:12345-0@lo:400: Request processed in 30us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381339.468969:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787381339.468983:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787381339.468989:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16461ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874205065889536:12345-0@lo:400: 00000100:00100000:0.0:1787381339.469044:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16461ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874205065889536:12345-0@lo:400: Request processed in 55us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381339.469050:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787381339.469063:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787381339.469079:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874205065889664:12345-0@lo:400: 00000100:00100000:0.0:1787381339.469107:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874205065889664:12345-0@lo:400: Request processed in 39us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381339.469113:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1787381339.469135:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787381339.469139:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787381339.469168:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a16461edf80 x1874205065889664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787381355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381339.469183:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1874205065889664:0@lo:400: 00010000:00080000:0.0:1787381339.469193:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a16461eed80 x1874205065889536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787381355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381339.469201:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874205065889536:0@lo:400: 00000100:00100000:0.0:1787381339.469228:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065889408:0@lo:400: 00010000:00080000:0.0:1787381339.469237:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a16461ef100 x1874205065889920/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787381355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381339.469245:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1874205065889920:0@lo:400: 00010000:00080000:0.0:1787381339.469253:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a16461ed500 x1874205065889792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787381355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381339.469270:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065889792:0@lo:400: 00010000:00010000:3.0:1787381340.045922:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787381340.492215:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787381340.492250:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065890048:0@lo:13: 00000100:00100000:0.0:1787381340.492312:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381340.492380:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065890048 00000100:00100000:0.0:1787381340.492387:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065890048 00000100:00100000:0.0:1787381340.492429:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787381340.492438:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a802a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065890048:12345-0@lo:13: 00002000:00000024:0.0:1787381340.492471:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787381340.492513:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a802a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065890048:12345-0@lo:13: Request processed in 76us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381340.492520:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787381340.492560:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a803b80 x1874205065890048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381356 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381340.492578:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065890048:0@lo:13: 10000000:01000000:0.0:1787381340.501893:0:5787:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787381340.501900:0:5787:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a1646496800 from 30 10000000:01000000:0.0:1787381340.501905:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787381340.501949:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1640030800/0xbdc38ada7ea0f87b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381340.501960:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a1640030800/0xbdc38ada7ea0f87b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381340.501971:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a1640030800/0xbdc38ada7ea0f87b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381340.502468:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a803b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065890176:0@lo:101: 00000100:00100000:0.0:1787381340.502538:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381340.502580:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f5963c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787381340.502655:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065890176 00000100:00100000:1.0:1787381340.502664:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065890176 00000100:00100000:1.0:1787381340.502714:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787381340.502722:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+13:5787:x1874205065890176:12345-0@lo:101: 00010000:00010000:1.0:1787381340.502735:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381340.502750:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a16413a1600/0xbdc38ada7ea0f882 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0f87b expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381340.502772:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a16413a1600/0xbdc38ada7ea0f882 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f87b expref: 14 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381340.502782:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a16413a1600/0xbdc38ada7ea0f882 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f87b expref: 14 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381340.502792:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16413a1600, rc 0) 00000100:00100000:1.0:1787381340.502834:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+14:5787:x1874205065890176:12345-0@lo:101: Request processed in 112us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381340.502841:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787381340.502977:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a803b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065890176:0@lo:101: 00010000:00010000:0.0:1787381340.502992:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a1640030800/0xbdc38ada7ea0f87b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f882 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381340.503001:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a1640030800/0xbdc38ada7ea0f87b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f882 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381340.503109:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a803b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065890304:0@lo:501: 00000100:00100000:0.0:1787381340.503136:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381340.503158:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065890304 00000100:00100000:0.0:1787381340.503162:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065890304 00000100:00100000:0.0:1787381340.503181:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787381340.503188:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646168850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+14:5787:x1874205065890304:12345-0@lo:501: 00000100:00100000:0.0:1787381340.503657:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646168850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+14:5787:x1874205065890304:12345-0@lo:501: Request processed in 468us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381340.503665:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787381340.503692:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f5963c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787381340.503704:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a803b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065890304:0@lo:501: 00000100:00100000:0.0:1787381340.503730:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a803b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065890432:0@lo:503: 00000100:00100000:0.0:1787381340.503772:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381340.503794:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065890432 00000100:00100000:0.0:1787381340.503799:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065890432 00000100:00100000:0.0:1787381340.503827:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787381340.503832:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+14:5787:x1874205065890432:12345-0@lo:503: 00000100:00100000:0.0:1787381340.503965:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+14:5787:x1874205065890432:12345-0@lo:503: Request processed in 131us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381340.503971:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787381340.504001:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f5963c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787381340.504045:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a803b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065890432:0@lo:503: 00000100:00100000:0.0:1787381340.504417:0:7765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a803b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:7765:1874205065890560:0@lo:502: 00000100:00100000:0.0:1787381340.504454:0:7765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381340.504475:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065890560 00000100:00100000:0.0:1787381340.504479:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065890560 00000100:00100000:0.0:1787381340.504501:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787381340.504508:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+14:7765:x1874205065890560:12345-0@lo:502: 00000100:00100000:0.0:1787381340.504718:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+14:7765:x1874205065890560:12345-0@lo:502: Request processed in 209us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381340.504725:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787381340.504758:0:7765:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1645ba3840 going to sleep for 11 seconds 00000100:00100000:0.0:1787381340.504772:0:7765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a803b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:7765:1874205065890560:0@lo:502: 00000100:00100000:0.0:1787381340.504811:0:7765:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a803b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:7765:1874205065890688:0@lo:502: 00000100:00100000:0.0:1787381340.504844:0:7765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381340.504863:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065890688 00000100:00100000:0.0:1787381340.504867:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065890688 00000100:00100000:0.0:1787381340.504888:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787381340.504894:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+14:7765:x1874205065890688:12345-0@lo:502: 00000100:00100000:0.0:1787381340.505094:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+14:7765:x1874205065890688:12345-0@lo:502: Request processed in 199us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381340.505107:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787381340.505137:0:7765:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1645ba3840 going to sleep for 11 seconds 00000100:00100000:0.0:1787381340.505150:0:7765:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a803b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:7765:1874205065890688:0@lo:502: 00000040:00080000:0.0:1787381340.505167:0:7765:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787381340.505304:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787381340.505321:0:5787:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787381340.505329:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1640030800/0xbdc38ada7ea0f87b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f882 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381340.505338:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a1640030800/0xbdc38ada7ea0f87b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f882 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787381340.505347:0:5787:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787381340.505350:0:5787:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1787381340.505352:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787381340.505375:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1640030a00/0xbdc38ada7ea0f889 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381340.505382:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a1640030a00/0xbdc38ada7ea0f889 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381340.505391:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a1640030a00/0xbdc38ada7ea0f889 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381340.505403:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a803b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065890816:0@lo:101: 00000100:00100000:0.0:1787381340.505429:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381340.505443:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16430ad480 going to sleep for 11 seconds 00000100:00100000:0.0:1787381340.505455:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065890816 00000100:00100000:0.0:1787381340.505458:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065890816 00000100:00100000:0.0:1787381340.505487:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787381340.505492:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+14:5787:x1874205065890816:12345-0@lo:101: 00010000:00010000:0.0:1787381340.505500:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381340.505511:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1640031000/0xbdc38ada7ea0f890 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0f889 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381340.505528:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1640031000/0xbdc38ada7ea0f890 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f889 expref: 15 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381340.505537:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1640031000/0xbdc38ada7ea0f890 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f889 expref: 15 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381340.505546:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1640031000, rc 0) 00000100:00100000:0.0:1787381340.505574:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+15:5787:x1874205065890816:12345-0@lo:101: Request processed in 81us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381340.505580:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787381340.505609:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a803b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065890816:0@lo:101: 00010000:00010000:0.0:1787381340.505618:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a1640030a00/0xbdc38ada7ea0f889 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f890 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381340.505626:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a1640030a00/0xbdc38ada7ea0f889 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f890 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381340.505735:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a803b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065890944:0@lo:501: 00000100:00100000:0.0:1787381340.505759:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381340.505772:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16430ad480 going to sleep for 11 seconds 00000100:00100000:0.0:1787381340.505782:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065890944 00000100:00100000:0.0:1787381340.505785:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065890944 00000100:00100000:0.0:1787381340.505804:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787381340.505817:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646168c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+15:5787:x1874205065890944:12345-0@lo:501: 00000100:00100000:0.0:1787381340.506132:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646168c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+15:5787:x1874205065890944:12345-0@lo:501: Request processed in 314us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381340.506139:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787381340.506172:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a803b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065890944:0@lo:501: 00000100:00100000:0.0:1787381340.506196:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a803b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065891072:0@lo:503: 00000100:00100000:0.0:1787381340.506299:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381340.506314:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16430ad480 going to sleep for 11 seconds 00000100:00100000:0.0:1787381340.506326:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065891072 00000100:00100000:0.0:1787381340.506329:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065891072 00000100:00100000:0.0:1787381340.506350:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787381340.506356:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+15:5787:x1874205065891072:12345-0@lo:503: 00000100:00100000:0.0:1787381340.506535:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+15:5787:x1874205065891072:12345-0@lo:503: Request processed in 178us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381340.506542:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787381340.506582:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a803b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065891072:0@lo:503: 00000100:00100000:1.0:1787381340.507632:0:7766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:7766:1874205065891200:0@lo:502: 00000100:00100000:1.0:1787381340.507769:0:7766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381340.507794:0:7766:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1650ba1180 going to sleep for 11 seconds 00000100:00100000:0.0:1787381340.507840:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065891200 00000100:00100000:0.0:1787381340.507846:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065891200 00000100:00100000:0.0:1787381340.507916:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787381340.507924:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+15:7766:x1874205065891200:12345-0@lo:502: 00000100:00100000:0.0:1787381340.508191:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+15:7766:x1874205065891200:12345-0@lo:502: Request processed in 267us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381340.508199:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787381340.508406:0:7766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:7766:1874205065891200:0@lo:502: 00000020:01000000:3.0:1787381340.508435:0:7766:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787381340.508444:0:7766:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787381340.508446:0:7766:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787381340.508452:0:7766:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787381340.508454:0:7766:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787381340.508475:0:7766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:7766:1874205065891328:0@lo:502: 00000100:00100000:3.0:1787381340.508511:0:7766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381340.509502:0:7766:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a15437e8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787381340.512504:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065891328 00000100:00100000:0.0:1787381340.512519:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065891328 00000100:00100000:0.0:1787381340.512567:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787381340.512583:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+15:7766:x1874205065891328:12345-0@lo:502: 00000100:00100000:0.0:1787381340.512844:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+15:7766:x1874205065891328:12345-0@lo:502: Request processed in 262us (4330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381340.512851:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787381340.513035:0:7766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:7766:1874205065891328:0@lo:502: 00000020:01000000:3.0:1787381340.513082:0:7766:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787381340.513089:0:7766:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787381340.513092:0:7766:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787381340.513097:0:7766:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1787381340.513472:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1787381340.513488:0:5787:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787381340.513497:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1640030a00/0xbdc38ada7ea0f889 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f890 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381340.513510:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a1640030a00/0xbdc38ada7ea0f889 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f890 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787381340.513519:0:5787:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787381340.513522:0:5787:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a16659a7000 from 30 10000000:01000000:0.0:1787381340.513525:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787381340.513554:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1640031e00/0xbdc38ada7ea0f897 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381340.513562:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a1640031e00/0xbdc38ada7ea0f897 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381340.513571:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a1640031e00/0xbdc38ada7ea0f897 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381340.513588:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a803b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065891456:0@lo:101: 00000100:00100000:0.0:1787381340.513628:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381340.513722:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16430ad540 going to sleep for 11 seconds 00000100:00100000:3.0:1787381340.513768:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065891456 00000100:00100000:3.0:1787381340.513774:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065891456 00000100:00100000:3.0:1787381340.513798:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787381340.513805:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+15:5787:x1874205065891456:12345-0@lo:101: 00010000:00010000:3.0:1787381340.513816:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381340.513828:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a168216dc00/0xbdc38ada7ea0f89e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0f897 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381340.513847:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a168216dc00/0xbdc38ada7ea0f89e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f897 expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381340.513869:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a168216dc00/0xbdc38ada7ea0f89e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f897 expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381340.513878:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a168216dc00, rc 0) 00000100:00100000:3.0:1787381340.513922:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+16:5787:x1874205065891456:12345-0@lo:101: Request processed in 117us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381340.513929:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787381340.515348:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a803b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065891456:0@lo:101: 00010000:00010000:0.0:1787381340.515371:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a1640031e00/0xbdc38ada7ea0f897 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f89e expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381340.515390:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a1640031e00/0xbdc38ada7ea0f897 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f89e expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381340.515456:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a803b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065891584:0@lo:501: 00000100:00100000:0.0:1787381340.515499:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381340.515532:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16430ad540 going to sleep for 11 seconds 00000100:00100000:0.0:1787381340.515550:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065891584 00000100:00100000:0.0:1787381340.515554:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065891584 00000100:00100000:0.0:1787381340.515582:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787381340.515602:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+16:5787:x1874205065891584:12345-0@lo:501: 00000100:00100000:0.0:1787381340.515905:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+16:5787:x1874205065891584:12345-0@lo:501: Request processed in 316us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381340.515912:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787381340.515947:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a803b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065891584:0@lo:501: 00000100:00100000:0.0:1787381340.515972:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a803b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065891712:0@lo:503: 00000100:00100000:0.0:1787381340.516030:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381340.516044:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16430ad540 going to sleep for 11 seconds 00000100:00100000:0.0:1787381340.516057:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065891712 00000100:00100000:0.0:1787381340.516069:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065891712 00000100:00100000:0.0:1787381340.516088:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787381340.516093:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+16:5787:x1874205065891712:12345-0@lo:503: 00000100:00100000:0.0:1787381340.519580:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+16:5787:x1874205065891712:12345-0@lo:503: Request processed in 126us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381340.519601:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787381340.520866:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a803b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065891712:0@lo:503: 00000100:00100000:0.0:1787381340.521104:0:7767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a803b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:7767:1874205065891840:0@lo:502: 00000100:00100000:0.0:1787381340.521172:0:7767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381340.521201:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065891840 00000100:00100000:0.0:1787381340.521206:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065891840 00000100:00100000:0.0:1787381340.523720:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787381340.523742:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+16:7767:x1874205065891840:12345-0@lo:502: 00000100:00100000:1.0:1787381340.525212:0:7767:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16430ad3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787381340.525384:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+16:7767:x1874205065891840:12345-0@lo:502: Request processed in 1649us (4208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381340.525395:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787381340.526134:0:7767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a803b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:7767:1874205065891840:0@lo:502: 00000100:00100000:1.0:1787381340.526216:0:7767:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:7767:1874205065891968:0@lo:502: 00000100:00100000:1.0:1787381340.526338:0:7767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381340.526365:0:7767:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1650ba1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787381340.529488:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065891968 00000100:00100000:0.0:1787381340.529502:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065891968 00000100:00100000:0.0:1787381340.529558:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787381340.529568:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+16:7767:x1874205065891968:12345-0@lo:502: 00000100:00100000:0.0:1787381340.529843:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+16:7767:x1874205065891968:12345-0@lo:502: Request processed in 276us (3503us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381340.529852:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787381340.530056:0:7767:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:7767:1874205065891968:0@lo:502: 00000040:00080000:1.0:1787381340.530102:0:7767:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787381340.530403:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787381340.530421:0:5787:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787381340.530431:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1640031e00/0xbdc38ada7ea0f897 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f89e expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381340.530442:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a1640031e00/0xbdc38ada7ea0f897 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f89e expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787381340.530451:0:5787:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787381340.530454:0:5787:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a16659a7000 from 5 10000000:01000000:0.0:1787381340.530456:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787381340.530485:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1640031600/0xbdc38ada7ea0f8a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381340.530500:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a1640031600/0xbdc38ada7ea0f8a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381340.530509:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a1640031600/0xbdc38ada7ea0f8a5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381340.530537:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a800e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065892096:0@lo:101: 00000100:00100000:0.0:1787381340.530572:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381340.530605:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a154340c900 going to sleep for 11 seconds 00000100:00100000:1.0:1787381340.533478:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065892096 00000100:00100000:1.0:1787381340.533492:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065892096 00000100:00100000:1.0:1787381340.533546:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787381340.533555:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+16:5787:x1874205065892096:12345-0@lo:101: 00010000:00010000:1.0:1787381340.533571:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381340.533590:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a16413a1000/0xbdc38ada7ea0f8ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0f8a5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381340.533618:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a16413a1000/0xbdc38ada7ea0f8ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f8a5 expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381340.533630:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a16413a1000/0xbdc38ada7ea0f8ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f8a5 expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381340.533648:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16413a1000, rc 0) 00000100:00100000:1.0:1787381340.533717:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+17:5787:x1874205065892096:12345-0@lo:101: Request processed in 163us (3144us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381340.533724:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787381340.533867:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a800e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065892096:0@lo:101: 00010000:00010000:0.0:1787381340.533883:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a1640031600/0xbdc38ada7ea0f8a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f8ac expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381340.533893:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a1640031600/0xbdc38ada7ea0f8a5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f8ac expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381340.533959:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a800e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065892224:0@lo:256: 00000100:00100000:0.0:1787381340.533997:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381340.534056:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a154340c900 going to sleep for 11 seconds 00000100:00100000:1.0:1787381340.534775:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065892224 00000100:00100000:1.0:1787381340.534782:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065892224 00000100:00100000:1.0:1787381340.534820:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787381340.534826:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+17:5787:x1874205065892224:12345-0@lo:256: 20000000:01000000:1.0:1787381340.534844:0:5783:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787381340.534873:0:5783:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787381340.534876:0:5783:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1787381340.534962:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+17:5787:x1874205065892224:12345-0@lo:256: Request processed in 135us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381340.534969:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787381340.535023:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a800e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065892224:0@lo:256: 10000000:01000000:1.0:1787381340.535074:0:5787:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787381340.535083:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1640031600/0xbdc38ada7ea0f8a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f8ac expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381340.535091:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a1640031600/0xbdc38ada7ea0f8a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f8ac expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787381340.535100:0:5787:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787381340.535102:0:5787:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1787381340.535105:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787381340.535128:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a16413a0a00/0xbdc38ada7ea0f8b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381340.535136:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a16413a0a00/0xbdc38ada7ea0f8b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381340.535144:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a16413a0a00/0xbdc38ada7ea0f8b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381340.535158:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065892352:0@lo:101: 00000100:00100000:1.0:1787381340.535187:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381340.535203:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1650ba13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787381340.535215:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065892352 00000100:00100000:1.0:1787381340.535218:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065892352 00000100:00100000:1.0:1787381340.535255:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787381340.535261:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+17:5787:x1874205065892352:12345-0@lo:101: 00010000:00010000:1.0:1787381340.535268:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381340.535292:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1541389e00/0xbdc38ada7ea0f8ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0f8b3 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381340.535311:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1541389e00/0xbdc38ada7ea0f8ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f8b3 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381340.535320:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1541389e00/0xbdc38ada7ea0f8ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f8b3 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381340.535327:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541389e00, rc 0) 00000100:00100000:1.0:1787381340.535356:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+18:5787:x1874205065892352:12345-0@lo:101: Request processed in 94us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381340.535361:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787381340.535392:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065892352:0@lo:101: 00010000:00010000:1.0:1787381340.535402:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a16413a0a00/0xbdc38ada7ea0f8b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f8ba expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381340.535409:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a16413a0a00/0xbdc38ada7ea0f8b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f8ba expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381340.535451:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065892480:0@lo:501: 00000100:00100000:1.0:1787381340.535475:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381340.535487:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1650ba13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787381340.535498:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065892480 00000100:00100000:1.0:1787381340.535501:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065892480 00000100:00100000:1.0:1787381340.535517:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787381340.535530:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+18:5787:x1874205065892480:12345-0@lo:501: 00000100:00100000:1.0:1787381340.535949:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+18:5787:x1874205065892480:12345-0@lo:501: Request processed in 420us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381340.535957:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787381340.535990:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065892480:0@lo:501: 00000100:00100000:1.0:1787381340.536034:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065892608:0@lo:503: 00000100:00100000:1.0:1787381340.536081:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381340.536096:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f596480 going to sleep for 11 seconds 00000100:00100000:1.0:1787381340.536107:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065892608 00000100:00100000:1.0:1787381340.536111:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065892608 00000100:00100000:1.0:1787381340.536130:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787381340.536136:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+18:5787:x1874205065892608:12345-0@lo:503: 00000100:00100000:1.0:1787381340.538764:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+18:5787:x1874205065892608:12345-0@lo:503: Request processed in 2618us (2672us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381340.538777:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787381340.541782:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065892608:0@lo:503: 00000100:00100000:1.0:1787381340.542948:0:7768:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:7768:1874205065892736:0@lo:502: 00000100:00100000:1.0:1787381340.543364:0:7768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381340.543439:0:7768:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1647423900 going to sleep for 11 seconds 00000100:00100000:2.0:1787381340.543485:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065892736 00000100:00100000:2.0:1787381340.543492:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065892736 00000100:00100000:2.0:1787381340.543569:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787381340.543580:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+18:7768:x1874205065892736:12345-0@lo:502: 00000100:00100000:2.0:1787381340.543878:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+18:7768:x1874205065892736:12345-0@lo:502: Request processed in 300us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381340.543897:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787381340.543980:0:7768:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:7768:1874205065892736:0@lo:502: 00000020:01000000:0.0:1787381340.544032:0:7768:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787381340.544040:0:7768:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787381340.544046:0:7768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787381340.544048:0:7768:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1787381340.544053:0:7768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787381340.544057:0:7768:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.122@tcp to nid 0x20000c0a8cb7a (192.168.203.122@tcp) 00000020:01000000:0.0:1787381340.544086:0:7768:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787381340.544094:0:7768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787381340.544107:0:7768:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9a1646133380) 00000020:00000080:0.0:1787381340.544129:0:7768:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1787381340.544135:0:7768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787381340.544202:0:7768:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1787381340.544208:0:7768:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:0.0:1787381340.544214:0:7768:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbdc38ada7ea0f8c8 00010000:00080000:0.0:1787381340.544440:0:7768:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a167f479000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.122@tcp at head 00010000:00010000:0.0:1787381340.544672:0:7768:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1787381340.545681:0:7768:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1787381340.545695:0:7768:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787381340.546346:0:7768:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787381340.546564:0:7768:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787381340.546646:0:7768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1787381340.546706:0:7768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1787381340.547553:0:7769:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787381340.547559:0:7769:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787381340.548369:0:7768:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787381340.548381:0:7768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787381340.548412:0:7768:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787381340.548432:0:7768:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbdc38ada7ea0f8cf 00000100:00080000:1.0:1787381340.548442:0:7768:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787381340.548449:0:7768:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a167f479000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:1.0:1787381340.548483:0:7768:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a167a33ca80 x1874205065892864/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787381340.548523:0:7768:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1787381340.548541:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1874205065892864:0@lo:8: 00000100:00100000:1.0:1787381340.548606:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874205065892992:0@lo:400: 00000100:00100000:3.0:1787381340.548880:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381340.549081:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1874205065893248:0@lo:400: 00000100:00100000:2.0:1787381340.549118:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381340.549142:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787381340.549150:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1874205065893120:0@lo:400: 00000100:00100000:2.0:1787381340.549173:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381340.549204:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065893248 00000100:00100000:2.0:1787381340.549210:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065893248 00000100:00100000:2.0:1787381340.549257:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065893120 00000100:00100000:2.0:1787381340.549261:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065893120 00000100:00100000:2.0:1787381340.549281:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787381340.549290:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874205065893248:12345-0@lo:400: 00000100:00100000:2.0:1787381340.549347:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874205065893248:12345-0@lo:400: Request processed in 57us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381340.549354:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787381340.549370:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787381340.549376:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874205065893120:12345-0@lo:400: 00000100:00100000:2.0:1787381340.549404:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874205065893120:12345-0@lo:400: Request processed in 28us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381340.549409:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1787381340.549446:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a33dc00 x1874205065893120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787381356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787381340.549459:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1874205065893120:0@lo:400: 00010000:00080000:2.0:1787381340.549469:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a33c380 x1874205065893248/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787381356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787381340.549490:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1874205065893248:0@lo:400: 00000100:00100000:0.0:1787381340.549820:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065892864 00000100:00100000:0.0:1787381340.549826:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065892864 00000100:00100000:0.0:1787381340.549855:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787381340.549862:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3307:x1874205065892864:12345-0@lo:8: 00010000:00080000:0.0:1787381340.549884:0:6588:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:0.0:1787381340.549908:0:6588:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbdc38ada7ea0f8d6 00002000:00100000:0.0:1787381340.549921:0:6588:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9a167f478800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113673 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787381340.549925:0:6588:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1787381340.549928:0:6588:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787381340.550168:0:6588:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787381340.550383:0:6588:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787381340.550406:0:6588:0:(import.c:65:import_set_state_nolock()) ffff9a167f47c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787381340.550524:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1874205065892864:12345-0@lo:8: Request processed in 660us (1643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381340.550532:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787381340.551239:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1787381340.551352:0:7768:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787381340.551359:0:7768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787381340.551361:0:7768:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787381340.551365:0:7768:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787381340.551369:0:7768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787381340.551370:0:7768:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787381340.551374:0:7768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787381340.551376:0:7768:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787381340.551405:0:7768:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:7768:1874205065893376:0@lo:502: 00000100:00100000:1.0:1787381340.551455:0:7768:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381340.551479:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065893376 00000100:00100000:1.0:1787381340.551484:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065893376 00000100:00100000:1.0:1787381340.551516:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787381340.551524:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+18:7768:x1874205065893376:12345-0@lo:502: 00000100:00100000:1.0:1787381340.551971:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+18:7768:x1874205065893376:12345-0@lo:502: Request processed in 447us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381340.551979:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787381340.552139:0:7768:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1647423900 going to sleep for 11 seconds 00000100:00100000:0.0:1787381340.552161:0:7768:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:7768:1874205065893376:0@lo:502: 00000020:01000000:0.0:1787381340.552183:0:7768:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787381340.552189:0:7768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787381340.552191:0:7768:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787381340.552195:0:7768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00010000:00080000:2.0:1787381340.552531:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a33ca80 x1874205065892864/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787381350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787381340.552542:0:3307:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787381340.552548:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787381340.552555:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787381340.552560:0:3307:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787381340.552563:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9a167f479000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787381340.552931:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787381340.552938:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1874205065892864:0@lo:8: 00000100:00100000:2.0:1787381340.552966:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065892992 00000100:00100000:2.0:1787381340.552971:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065892992 00000004:00080000:0.0:1787381340.553101:0:7769:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787381340.553210:0:7769:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 198684205136ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787381340.553594:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787381340.553604:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a33e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874205065892992:12345-0@lo:400: 00000100:00100000:2.0:1787381340.553993:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a33e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874205065892992:12345-0@lo:400: Request processed in 390us (2754us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381340.554001:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1787381340.554137:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a33f100 x1874205065892992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787381356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381340.554150:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874205065892992:0@lo:400: 00000020:01000000:2.0:1787381340.559484:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1787381340.559517:0:5787:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787381340.559529:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a16413a0a00/0xbdc38ada7ea0f8b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f8ba expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381340.559544:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a16413a0a00/0xbdc38ada7ea0f8b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f8ba expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787381340.559554:0:5787:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787381340.559563:0:5787:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9a1646130000 from 1 10000000:01000000:2.0:1787381340.559566:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787381340.559602:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a164166a600/0xbdc38ada7ea0f8dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381340.559611:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a164166a600/0xbdc38ada7ea0f8dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381340.559621:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a164166a600/0xbdc38ada7ea0f8dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381340.560730:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065893504:0@lo:101: 00000100:00100000:2.0:1787381340.567825:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381340.567865:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f94ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1787381340.567886:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065893504 00000100:00100000:2.0:1787381340.567893:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065893504 00000100:00100000:2.0:1787381340.567939:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787381340.567946:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+18:5787:x1874205065893504:12345-0@lo:101: 00010000:00010000:2.0:1787381340.567961:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381340.567979:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a164166b000/0xbdc38ada7ea0f8e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0f8dd expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381340.569382:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a164166b000/0xbdc38ada7ea0f8e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f8dd expref: 19 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381340.569403:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a164166b000/0xbdc38ada7ea0f8e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f8dd expref: 19 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381340.569412:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a164166b000, rc 0) 00000100:00100000:2.0:1787381340.569477:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+19:5787:x1874205065893504:12345-0@lo:101: Request processed in 1530us (1655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381340.569493:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787381340.569549:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065893504:0@lo:101: 00010000:00010000:2.0:1787381340.569565:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a164166a600/0xbdc38ada7ea0f8dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f8e4 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381340.569574:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a164166a600/0xbdc38ada7ea0f8dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f8e4 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381340.570630:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065893632:0@lo:501: 00000100:00100000:2.0:1787381340.571162:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381340.571196:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f94ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1787381340.571218:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065893632 00000100:00100000:2.0:1787381340.571482:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065893632 00000100:00100000:2.0:1787381340.571797:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787381340.571809:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+19:5787:x1874205065893632:12345-0@lo:501: 00000100:00100000:2.0:1787381340.572040:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+19:5787:x1874205065893632:12345-0@lo:501: Request processed in 197us (843us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787381340.572048:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787381340.581463:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065893632:0@lo:501: 10000000:01000000:2.0:1787381340.581510:0:5787:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787381340.581521:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a164166a600/0xbdc38ada7ea0f8dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f8e4 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381340.581532:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a164166a600/0xbdc38ada7ea0f8dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f8e4 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787381340.621127:0:5813:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1787381340.700140:0:7770:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787381340.700175:0:7770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a800380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7770:1874205065893888:0@lo:7: 00000100:00100000:0.0:1787381340.700320:0:7770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381340.700366:0:7770:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a154340c600 going to sleep for 11 seconds 00000100:00100000:0.0:1787381340.700394:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787381340.700408:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a801180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065893760:0@lo:13: 00000100:00100000:0.0:1787381340.700437:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381340.700471:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065893888 00000100:00100000:0.0:1787381340.700478:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065893888 00000100:00100000:0.0:1787381340.700533:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787381340.700542:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7770:x1874205065893888:12345-0@lo:7: 00000100:00080000:3.0:1787381340.703075:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787381340.703097:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065893760 00000100:00100000:3.0:1787381340.703107:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065893760 00000100:00100000:3.0:1787381340.703159:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787381340.703171:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874205065893760:12345-0@lo:13: 00002000:00000024:3.0:1787381340.703205:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1787381340.703578:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874205065893760:12345-0@lo:13: Request processed in 410us (3139us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381340.703588:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787381340.703640:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a801180 x1874205065893760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381356 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787381340.703659:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a801180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065893760:0@lo:13: 00002000:00080000:1.0:1787381340.710169:0:6587:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1787381340.710179:0:6587:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787381340.710266:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7770:x1874205065893888:12345-0@lo:7: Request processed in 9722us (9943us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381340.710278:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787381340.710525:0:7770:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a800380 x1874205065893888/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787381356 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381340.710554:0:7770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a800380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7770:1874205065893888:0@lo:7: 00000004:00080000:0.0:1787381340.710567:0:7770:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787381340.710603:0:7770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a800380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7770:1874205065894016:0@lo:5: 00000100:00100000:0.0:1787381340.710711:0:7770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381340.710760:0:7770:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a154340c600 going to sleep for 11 seconds 00000100:00100000:0.0:1787381340.710775:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065894016 00000100:00100000:0.0:1787381340.710781:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065894016 00000100:00100000:0.0:1787381340.710824:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787381340.710833:0:6590:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787381340.710833:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7770:x1874205065894016:12345-0@lo:5: 00000100:00100000:2.0:1787381340.710844:0:6590:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00080000:0.0:1787381340.710872:0:6588:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787381340.710876:0:6588:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1787381340.711380:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7770:x1874205065894016:12345-0@lo:5: Request processed in 547us (670us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787381340.711600:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787381340.711636:0:7770:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a800380 x1874205065894016/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787381356 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381340.711708:0:7770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a800380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7770:1874205065894016:0@lo:5: 00000004:00080000:0.0:1787381340.711718:0:7770:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787381340.711747:0:7770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a802300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7770:1874205065894144:0@lo:700: 00000100:00100000:0.0:1787381340.711779:0:7770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381340.711798:0:7770:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a154340c600 going to sleep for 11 seconds 00000100:00100000:1.0:1787381340.713556:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065894144 00000100:00100000:1.0:1787381340.713568:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065894144 00000100:00100000:1.0:1787381340.713631:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787381340.713641:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7770:x1874205065894144:12345-0@lo:700: 00000100:00100000:1.0:1787381340.713694:0:6596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33f480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6596:1874205065894272:0@lo:700: 00000100:00100000:1.0:1787381340.714027:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381340.714056:0:6596:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1674ec8600 going to sleep for 11 seconds 00000100:00100000:1.0:1787381340.714088:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065894272 00000100:00100000:1.0:1787381340.714093:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065894272 00000100:00100000:1.0:1787381340.714121:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787381340.714128:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a33f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6596:x1874205065894272:12345-0@lo:700: 40000000:02000000:0.0:1787381340.824076:0:5797:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1787381340.850119:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a33f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6596:x1874205065894272:12345-0@lo:700: Request processed in 135981us (136108us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381340.850134:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787381340.850288:0:6596:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a33f480 x1874205065894272/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787381356 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787381340.850304:0:6596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33f480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6596:1874205065894272:0@lo:700: 40000000:02000000:2.0:1787381340.850316:0:6596:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:2.0:1787381340.992607:0:7481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1787381340.992625:0:7481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787381340.993106:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a801f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7770:x1874205065894144:12345-0@lo:700: Request processed in 279459us (281318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381340.993121:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787381340.998994:0:7770:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a802300 x1874205065894144/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787381356 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381340.999032:0:7770:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787381340.999048:0:7770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a802300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7770:1874205065894144:0@lo:700: 00010000:00010000:2.0:1787381341.070651:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:02000040:0.0:1787381341.092210:0:7770:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1787381341.101128:0:7770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a800700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7770:1874205065894400:0@lo:5: 00000100:00100000:0.0:1787381341.101190:0:7770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381341.101249:0:7770:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a154340cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787381341.101362:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065894400 00000100:00100000:3.0:1787381341.101370:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065894400 00000100:00100000:3.0:1787381341.101441:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787381341.101449:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7770:x1874205065894400:12345-0@lo:5: 00002000:00080000:0.0:1787381341.122646:0:6587:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1787381341.122671:0:6587:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1787381341.133131:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7770:x1874205065894400:12345-0@lo:5: Request processed in 31677us (31934us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787381341.133145:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787381341.133211:0:7770:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a800700 x1874205065894400/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787381357 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381341.133796:0:7770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a800700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7770:1874205065894400:0@lo:5: 00000004:00080000:1.0:1787381341.133812:0:7770:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000001:02000400:0.0:1787381341.306562:0:7830:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787381342.092271:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381343.116194:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381344.140623:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381345.164553:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787381345.616617:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd19486c-5291-4823-bb9c-f3a73416a496:3311:1874205065894528:0@lo:400: 00000100:00100000:1.0:1787381345.616685:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381345.616742:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1874205065895040:0@lo:400: 00000100:00100000:1.0:1787381345.616768:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381345.616792:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787381345.616798:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065894912:0@lo:400: 00000100:00100000:1.0:1787381345.616821:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381345.616863:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874205065894656:0@lo:400: 00000100:00100000:1.0:1787381345.616886:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381345.616901:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a802300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065895168:0@lo:400: 00000100:00100000:1.0:1787381345.616920:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381345.616934:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787381345.616939:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a800a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1874205065894784:0@lo:400: 00000100:00100000:1.0:1787381345.616958:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381345.616988:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065895040 00000100:00100000:1.0:1787381345.616995:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065895040 00000100:00100000:1.0:1787381345.617078:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065894656 00000100:00100000:1.0:1787381345.617082:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065894656 00000100:00100000:1.0:1787381345.617096:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065894784 00000100:00100000:1.0:1787381345.617099:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065894784 00000100:00100000:1.0:1787381345.617114:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787381345.617121:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a33c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874205065895040:12345-0@lo:400: 00000100:00100000:1.0:1787381345.617173:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a33c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874205065895040:12345-0@lo:400: Request processed in 51us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381345.617181:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787381345.617200:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787381345.617206:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a33df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874205065894656:12345-0@lo:400: 00000100:00100000:1.0:1787381345.617237:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a33df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874205065894656:12345-0@lo:400: Request processed in 31us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381345.617243:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787381345.617256:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787381345.617261:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a33f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874205065894784:12345-0@lo:400: 00000100:00100000:1.0:1787381345.617284:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a33f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874205065894784:12345-0@lo:400: Request processed in 24us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381345.617299:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787381345.617318:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065894912 00000100:00100000:1.0:1787381345.617321:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065894912 00000100:00100000:1.0:1787381345.617342:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065895168 00000100:00100000:1.0:1787381345.617345:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065895168 00000100:00100000:1.0:1787381345.617360:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787381345.617366:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a33d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065894912:12345-0@lo:400: 00000100:00100000:1.0:1787381345.617394:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a33d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065894912:12345-0@lo:400: Request processed in 28us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381345.617400:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787381345.617410:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787381345.617416:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a33f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1874205065895168:12345-0@lo:400: 00000100:00100000:1.0:1787381345.617441:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a33f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1874205065895168:12345-0@lo:400: Request processed in 26us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381345.617446:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787381345.617592:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787381345.617597:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787381345.617599:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787381345.617627:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a800a80 x1874205065894784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787381361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381345.617640:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a800a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1874205065894784:0@lo:400: 00010000:00080000:1.0:1787381345.617651:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a801880 x1874205065894656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787381361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381345.617659:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a801880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874205065894656:0@lo:400: 00010000:00080000:1.0:1787381345.617669:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a802300 x1874205065895168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787381361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381345.617689:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a802300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065895168:0@lo:400: 00010000:00080000:1.0:1787381345.617724:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a803100 x1874205065894912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787381361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381345.617733:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065894912:0@lo:400: 00010000:00080000:1.0:1787381345.617741:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a802d80 x1874205065895040/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787381361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381345.617749:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a802d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1874205065895040:0@lo:400: 00000100:00100000:2.0:1787381345.618095:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065895296:0@lo:13: 00000100:00100000:2.0:1787381345.618128:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381345.618165:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065895296 00000100:00100000:2.0:1787381345.618170:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065895296 00000100:00100000:2.0:1787381345.618197:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787381345.618204:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065895296:12345-0@lo:13: 00002000:00000024:2.0:1787381345.618237:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787381345.618273:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065895296:12345-0@lo:13: Request processed in 69us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381345.618279:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787381345.618306:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a6f6d80 x1874205065895296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381361 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787381345.618318:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065895296:0@lo:13: 00000100:00100000:0.0:1787381345.618882:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065894528 00000100:00100000:0.0:1787381345.618887:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065894528 00000100:00100000:0.0:1787381345.618927:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787381345.618934:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+19:3311:x1874205065894528:12345-0@lo:400: 00000100:00100000:0.0:1787381345.618986:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+19:3311:x1874205065894528:12345-0@lo:400: Request processed in 52us (2302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381345.618993:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787381345.619124:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a803800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd19486c-5291-4823-bb9c-f3a73416a496:3311:1874205065894528:0@lo:400: 00000100:00100000:0.0:1787381346.125345:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787381346.149429:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065895424:0@lo:13: 00000100:00100000:0.0:1787381346.153550:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381346.155406:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065895424 00000100:00100000:0.0:1787381346.155420:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065895424 00000100:00100000:0.0:1787381346.155477:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787381346.155487:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874205065895424:12345-0@lo:13: 00002000:00000024:0.0:1787381346.155521:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787381346.155585:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874205065895424:12345-0@lo:13: Request processed in 100us (2041us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381346.155603:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787381346.155669:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a33ca80 x1874205065895424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381362 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381346.155691:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065895424:0@lo:13: 00010000:00010000:3.0:1787381346.190249:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787381346.211728:0:7481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:1.0:1787381347.121976:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381347.122103:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205046997120 00000100:00100000:2.0:1787381347.122114:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205046997120 00000100:00100000:2.0:1787381347.122150:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 112 00000100:00100000:2.0:1787381347.122158:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2348:x1874205046997120:12345-192.168.203.22@tcp:250: 00010000:00080000:2.0:1787381347.122183:0:5784:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from c93c8548-229c-4d2f-8357-13904b6fe0fb@192.168.203.22@tcp t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:2.0:1787381347.122209:0:5784:0:(genops.c:1406:class_connect()) connect: client c93c8548-229c-4d2f-8357-13904b6fe0fb, cookie 0xbdc38ada7ea0f8eb 00000100:00080000:2.0:1787381347.122319:0:5784:0:(import.c:65:import_set_state_nolock()) ffff9a1675061800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787381347.122378:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+5:2348:x1874205046997120:12345-192.168.203.22@tcp:250: Request processed in 220us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381347.122386:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 112 00000100:00100000:1.0:1787381347.155633:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381347.155669:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205046997248 00000100:00100000:1.0:1787381347.155677:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205046997248 00000100:00100000:1.0:1787381347.155741:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 113 00000100:00100000:1.0:1787381347.155749:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1650553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+5:5552:x1874205046997248:12345-192.168.203.22@tcp:101: 00010000:00010000:1.0:1787381347.155764:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381347.155780:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1541389a00/0xbdc38ada7ea0f8f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc01952459a9535bb expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381347.155806:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1541389a00/0xbdc38ada7ea0f8f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9535bb expref: 6 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381347.155816:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1541389a00/0xbdc38ada7ea0f8f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9535bb expref: 6 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381347.155824:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541389a00, rc 0) 00000100:00100000:1.0:1787381347.155870:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1650553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+6:5552:x1874205046997248:12345-192.168.203.22@tcp:101: Request processed in 122us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381347.155883:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 113 00000100:00100000:3.0:1787381347.170535:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381347.170580:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205046997376 00000100:00100000:3.0:1787381347.170594:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205046997376 00000100:00100000:3.0:1787381347.170658:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 114 00000100:00100000:3.0:1787381347.170671:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1650552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+6:5552:x1874205046997376:12345-192.168.203.22@tcp:501: 00000100:00100000:3.0:1787381347.171138:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1650552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+6:5552:x1874205046997376:12345-192.168.203.22@tcp:501: Request processed in 468us (616us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787381347.171149:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 114 00000100:00100000:1.0:1787381347.178149:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381347.184946:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205046997504 00000100:00100000:2.0:1787381347.184966:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205046997504 00000100:00100000:2.0:1787381347.185067:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 115 00000100:00100000:2.0:1787381347.185081:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+6:5552:x1874205046997504:12345-192.168.203.22@tcp:101: 00010000:00010000:2.0:1787381347.185104:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381347.185128:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a164166b400/0xbdc38ada7ea0f8f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc01952459a9535c2 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381347.185183:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a164166b400/0xbdc38ada7ea0f8f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9535c2 expref: 7 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381347.185197:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a164166b400/0xbdc38ada7ea0f8f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9535c2 expref: 7 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381347.185207:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a164166b400, rc 0) 00000100:00100000:2.0:1787381347.185296:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+7:5552:x1874205046997504:12345-192.168.203.22@tcp:101: Request processed in 220us (7162us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381347.185317:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 115 00000100:00100000:3.0:1787381347.190911:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381347.191208:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205046997632 00000100:00100000:2.0:1787381347.191223:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205046997632 00000100:00100000:2.0:1787381347.191287:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 116 00000100:00100000:2.0:1787381347.191298:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+7:5552:x1874205046997632:12345-192.168.203.22@tcp:501: 00000100:00100000:2.0:1787381347.191707:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+8:5552:x1874205046997632:12345-192.168.203.22@tcp:501: Request processed in 409us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381347.191717:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 116 00000100:00100000:2.0:1787381347.194701:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381347.194870:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205046997760 00000100:00100000:3.0:1787381347.194883:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205046997760 00000100:00100000:3.0:1787381347.194950:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 117 00000100:00100000:3.0:1787381347.194962:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+8:5552:x1874205046997760:12345-192.168.203.22@tcp:503: 00000100:00100000:3.0:1787381347.195783:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+8:5552:x1874205046997760:12345-192.168.203.22@tcp:503: Request processed in 815us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381347.195794:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 117 00000100:00100000:2.0:1787381347.213518:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00010000:00010000:2.0:1787381347.213612:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787381347.214185:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205046997888 00000100:00100000:3.0:1787381347.214201:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205046997888 00000100:00100000:3.0:1787381347.214277:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 118 00000100:00100000:3.0:1787381347.214289:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+8:5571:x1874205046997888:12345-192.168.203.22@tcp:502: 00000100:00100000:3.0:1787381347.214751:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+8:5571:x1874205046997888:12345-192.168.203.22@tcp:502: Request processed in 461us (1244us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381347.214768:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 118 00000100:00100000:0.0:1787381347.267412:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381347.267448:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205046998016 00000100:00100000:3.0:1787381347.267462:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205046998016 00000100:00100000:3.0:1787381347.267528:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 119 00000100:00100000:3.0:1787381347.267539:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+8:5571:x1874205046998016:12345-192.168.203.22@tcp:502: 00000100:00100000:3.0:1787381347.270228:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+8:5571:x1874205046998016:12345-192.168.203.22@tcp:502: Request processed in 2672us (2816us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381347.270247:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 119 00000100:00100000:2.0:1787381347.297279:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381347.297329:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205046998144 00000100:00100000:2.0:1787381347.297348:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205046998144 00000100:00100000:2.0:1787381347.297417:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 120 00000100:00100000:2.0:1787381347.297429:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+8:5552:x1874205046998144:12345-192.168.203.22@tcp:101: 00010000:00010000:2.0:1787381347.297454:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381347.297480:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a164166b200/0xbdc38ada7ea0f900 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc01952459a9535ec expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381347.297517:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a164166b200/0xbdc38ada7ea0f900 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9535ec expref: 9 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381347.297530:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a164166b200/0xbdc38ada7ea0f900 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9535ec expref: 9 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381347.297542:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a164166b200, rc 0) 00000100:00100000:2.0:1787381347.297633:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+9:5552:x1874205046998144:12345-192.168.203.22@tcp:101: Request processed in 206us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381347.297641:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 120 00000100:00100000:1.0:1787381347.302565:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381347.303622:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205046998272 00000100:00100000:3.0:1787381347.303640:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205046998272 00000100:00100000:3.0:1787381347.303716:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 121 00000100:00100000:3.0:1787381347.303729:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+9:5552:x1874205046998272:12345-192.168.203.22@tcp:256: 20000000:01000000:3.0:1787381347.303763:0:5785:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787381347.303798:0:5785:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787381347.303803:0:5785:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787381347.303805:0:5785:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787381347.303808:0:5785:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1787381347.309845:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+9:5552:x1874205046998272:12345-192.168.203.22@tcp:256: Request processed in 6101us (7277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381347.309863:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 121 00000100:00100000:3.0:1787381347.314942:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381347.315051:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205046998400 00000100:00100000:2.0:1787381347.315066:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205046998400 00000100:00100000:2.0:1787381347.315139:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 122 00000100:00100000:2.0:1787381347.315159:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+9:5552:x1874205046998400:12345-192.168.203.22@tcp:101: 00010000:00010000:2.0:1787381347.315197:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381347.315221:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a164166be00/0xbdc38ada7ea0f907 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc01952459a9535f3 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381347.315260:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a164166be00/0xbdc38ada7ea0f907 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9535f3 expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381347.315274:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a164166be00/0xbdc38ada7ea0f907 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9535f3 expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381347.315287:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a164166be00, rc 0) 00000100:00100000:2.0:1787381347.315372:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:5552:x1874205046998400:12345-192.168.203.22@tcp:101: Request processed in 215us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381347.315380:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 122 00000100:00100000:1.0:1787381347.326855:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381347.326941:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205046998528 00000100:00100000:3.0:1787381347.326954:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205046998528 00000100:00100000:3.0:1787381347.327059:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 123 00000100:00100000:3.0:1787381347.327073:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:5552:x1874205046998528:12345-192.168.203.22@tcp:501: 00000100:00100000:3.0:1787381347.327403:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:5552:x1874205046998528:12345-192.168.203.22@tcp:501: Request processed in 332us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381347.327421:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 123 00000100:00100000:1.0:1787381347.330719:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381347.330802:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205046998656 00000100:00100000:3.0:1787381347.330816:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205046998656 00000100:00100000:3.0:1787381347.330886:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 124 00000100:00100000:3.0:1787381347.330899:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:5552:x1874205046998656:12345-192.168.203.22@tcp:503: 00000100:00100000:3.0:1787381347.331484:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:5552:x1874205046998656:12345-192.168.203.22@tcp:503: Request processed in 586us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381347.331495:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 124 00000100:00100000:3.0:1787381347.335458:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381347.335713:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205046998784 00000100:00100000:1.0:1787381347.335727:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205046998784 00000100:00100000:1.0:1787381347.335798:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 125 00000100:00100000:1.0:1787381347.335811:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:5575:x1874205046998784:12345-192.168.203.22@tcp:502: 00000100:00100000:1.0:1787381347.336212:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:5575:x1874205046998784:12345-192.168.203.22@tcp:502: Request processed in 403us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381347.336223:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 125 00000100:00100000:2.0:1787381347.342496:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381347.349280:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205046998912 00000100:00100000:0.0:1787381347.349301:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205046998912 00000100:00100000:0.0:1787381347.349411:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 126 00000100:00100000:0.0:1787381347.349425:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:5575:x1874205046998912:12345-192.168.203.22@tcp:502: 00000100:00100000:0.0:1787381347.349813:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:5575:x1874205046998912:12345-192.168.203.22@tcp:502: Request processed in 390us (7330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381347.349823:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 126 00000100:00100000:3.0:1787381347.355317:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381347.355831:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205046999040 00000100:00100000:1.0:1787381347.355849:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205046999040 00000100:00100000:1.0:1787381347.355963:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:1.0:1787381347.355975:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2348:x1874205046999040:12345-192.168.203.22@tcp:38: 00010000:00080000:1.0:1787381347.356046:0:5791:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from f2157c09-10df-40cb-8228-ad4822122c97@192.168.203.22@tcp t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:1.0:1787381347.356116:0:5791:0:(genops.c:1406:class_connect()) connect: client f2157c09-10df-40cb-8228-ad4822122c97, cookie 0xbdc38ada7ea0f90e 00000004:00100000:3.0:1787381347.357798:0:5791:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1787381347.357811:0:5791:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1787381347.441056:0:5791:0:(import.c:65:import_set_state_nolock()) ffff9a1675360000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787381347.441836:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+6:2348:x1874205046999040:12345-192.168.203.22@tcp:38: Request processed in 85196us (85884us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381347.441866:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 4 00010000:00010000:3.0:1787381348.236501:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787381348.446516:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381348.446695:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205046999296 00000100:00100000:2.0:1787381348.446708:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205046999296 00000100:00100000:2.0:1787381348.446800:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:2.0:1787381348.446811:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a33fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+6:5552:x1874205046999296:12345-192.168.203.22@tcp:41: 00000004:00000024:2.0:1787381348.446871:0:5790:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787381348.446959:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a33fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+6:5552:x1874205046999296:12345-192.168.203.22@tcp:41: Request processed in 151us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381348.446980:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00080000:1.0:1787381348.447708:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787381348.448235:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381348.453818:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205046999168 00000100:00100000:3.0:1787381348.453839:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205046999168 00000100:00100000:3.0:1787381348.454036:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:3.0:1787381348.454050:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+6:0:x1874205046999168:12345-192.168.203.22@tcp:41: 00000004:00000024:3.0:1787381348.454092:0:5791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1787381348.454199:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+6:0:x1874205046999168:12345-192.168.203.22@tcp:41: Request processed in 151us (5965us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381348.454206:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:0.0:1787381348.461400:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381348.465337:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205046999424 00000100:00100000:3.0:1787381348.465381:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205046999424 00000100:00100000:3.0:1787381348.465545:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:3.0:1787381348.465559:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a801180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+6:5552:x1874205046999424:12345-192.168.203.22@tcp:40: 00000100:00100000:3.0:1787381348.467322:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a801180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+6:5552:x1874205046999424:12345-192.168.203.22@tcp:40: Request processed in 1752us (5922us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381348.467338:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:1.0:1787381348.489293:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381348.489359:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381348.489387:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381348.489434:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381348.489694:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205046999936 00000100:00100000:3.0:1787381348.489708:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205046999936 00000100:00100000:3.0:1787381348.489787:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 127 00000100:00100000:3.0:1787381348.489798:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:2350:x1874205046999936:12345-192.168.203.22@tcp:400: 00000100:00100000:3.0:1787381348.489897:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:2350:x1874205046999936:12345-192.168.203.22@tcp:400: Request processed in 100us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381348.489905:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 127 00000100:00100000:2.0:1787381348.490063:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205046999808 00000100:00100000:2.0:1787381348.490069:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205046999808 00000100:00100000:2.0:1787381348.490105:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:2.0:1787381348.490112:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a33c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+6:5552:x1874205046999808:12345-192.168.203.22@tcp:33: 00000100:00100000:2.0:1787381348.490210:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205046999552 00000100:00100000:2.0:1787381348.490214:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205046999552 00000100:00100000:2.0:1787381348.490233:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205046999680 00000100:00100000:2.0:1787381348.490235:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205046999680 00000100:00100000:2.0:1787381348.490250:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:2.0:1787381348.490256:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a33dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2348:x1874205046999552:12345-192.168.203.22@tcp:8: 00010000:00080000:2.0:1787381348.490283:0:7779:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from f2157c09-10df-40cb-8228-ad4822122c97@192.168.203.22@tcp t0 exp 0000000000000000 cur 206 last 0 00000020:00000080:2.0:1787381348.490323:0:7779:0:(genops.c:1406:class_connect()) connect: client f2157c09-10df-40cb-8228-ad4822122c97, cookie 0xbdc38ada7ea0f915 00002000:00100000:2.0:1787381348.490339:0:7779:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f2157c09-10df-40cb-8228-ad4822122c97/ffff9a1675063800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113673 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787381348.490369:0:7779:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787381348.490797:0:7779:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787381348.490833:0:7779:0:(import.c:65:import_set_state_nolock()) ffff9a1675066800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787381348.490882:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a33dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2157c09-10df-40cb-8228-ad4822122c97+6:2348:x1874205046999552:12345-192.168.203.22@tcp:8: Request processed in 624us (1493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381348.490890:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:2.0:1787381348.490911:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:2.0:1787381348.490916:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a33ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2348:x1874205046999680:12345-192.168.203.22@tcp:8: 00010000:00080000:2.0:1787381348.490934:0:7779:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from f2157c09-10df-40cb-8228-ad4822122c97@192.168.203.22@tcp t0 exp 0000000000000000 cur 206 last 0 00000020:00000080:2.0:1787381348.490952:0:7779:0:(genops.c:1406:class_connect()) connect: client f2157c09-10df-40cb-8228-ad4822122c97, cookie 0xbdc38ada7ea0f91c 00002000:00100000:2.0:1787381348.490977:0:7779:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f2157c09-10df-40cb-8228-ad4822122c97/ffff9a1675062000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113673 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787381348.490994:0:7779:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787381348.491263:0:7779:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787381348.491280:0:7779:0:(import.c:65:import_set_state_nolock()) ffff9a1675060800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787381348.491307:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a33ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2157c09-10df-40cb-8228-ad4822122c97+6:2348:x1874205046999680:12345-192.168.203.22@tcp:8: Request processed in 389us (1872us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381348.491314:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 9 00000004:00080000:0.0:1787381348.526353:0:5793:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 36167us 00000004:00200000:1.0:1787381348.568395:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787381348.568630:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a33c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+6:5552:x1874205046999808:12345-192.168.203.22@tcp:33: Request processed in 78511us (79345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381348.568657:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 0 00000001:00100000:2.0:1787381348.747507:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f2157c09-10df-40cb-8228-ad4822122c97 00000100:00100000:0.0:1787381348.841581:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381348.841680:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047000064 00000100:00100000:3.0:1787381348.841690:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047000064 00000100:00100000:3.0:1787381348.841861:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:3.0:1787381348.841871:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a800e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+6:5592:x1874205047000064:12345-192.168.203.22@tcp:101: 00010000:00010000:3.0:1787381348.841889:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381348.841911:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a168216da00/0xbdc38ada7ea0f923 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a95361d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381348.841968:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a168216c000/0xbdc38ada7ea0f92a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381348.841981:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a168216c000/0xbdc38ada7ea0f92a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381348.841993:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a168216c000/0xbdc38ada7ea0f92a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787381348.842207:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787381348.842211:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787381348.842285:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a168216c000/0xbdc38ada7ea0f92a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381348.842312:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a168216da00/0xbdc38ada7ea0f923 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95361d expref: 8 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381348.842328:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a168216c000/0xbdc38ada7ea0f92a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95361d expref: 7 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381348.842337:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1643052500) 00010000:00010000:3.0:1787381348.842340:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787381348.842343:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a168216c000, rc 0) 00000100:00100000:3.0:1787381348.842402:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a800e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+7:5592:x1874205047000064:12345-192.168.203.22@tcp:101: Request processed in 533us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381348.842409:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 8 00010000:00010000:2.0:1787381349.261344:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381350.284211:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787381350.732208:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787381350.732235:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874205065895808:0@lo:400: 00000100:00100000:1.0:1787381350.732240:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1874205065895936:0@lo:400: 00000100:00100000:0.0:1787381350.732317:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd19486c-5291-4823-bb9c-f3a73416a496:3311:1874205065895680:0@lo:400: 00000100:00100000:3.0:1787381350.732342:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1874205065896192:0@lo:400: 00000100:00100000:1.0:1787381350.738071:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381350.738184:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065895936 00000100:00100000:1.0:1787381350.738193:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065895936 00000100:00100000:1.0:1787381350.738254:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787381350.738264:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874205065895936:12345-0@lo:400: 00000100:00100000:1.0:1787381350.738323:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874205065895936:12345-0@lo:400: Request processed in 61us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381350.738330:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1787381350.738351:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787381350.738380:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1874205065895936:0@lo:400: 00000100:00100000:2.0:1787381350.738451:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381350.738493:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065896320:0@lo:400: 00000100:00100000:2.0:1787381350.738527:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381350.738552:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065896320 00000100:00100000:2.0:1787381350.738555:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065896320 00000100:00100000:2.0:1787381350.738599:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787381350.738608:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065896320:12345-0@lo:400: 00000100:00080000:1.0:1787381350.738657:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787381350.738669:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065895808 00000100:00100000:1.0:1787381350.738672:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065895808 00000100:00100000:1.0:1787381350.738710:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787381350.738716:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874205065895808:12345-0@lo:400: 00000100:00100000:1.0:1787381350.738750:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874205065895808:12345-0@lo:400: Request processed in 34us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381350.738756:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787381350.738835:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065896320:12345-0@lo:400: Request processed in 228us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381350.738841:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787381350.738870:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167f59e680 x1874205065896320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787381366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787381350.738879:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787381350.738889:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065896320:0@lo:400: 00000100:00100000:2.0:1787381350.738895:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065895552:0@lo:13: 00000100:00100000:2.0:1787381350.738933:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381350.738973:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874205065895808:0@lo:400: 00000100:00100000:1.0:1787381350.740850:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065895552 00000100:00100000:1.0:1787381350.740863:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065895552 00000100:00100000:1.0:1787381350.740943:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787381350.740953:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065895552:12345-0@lo:13: 00002000:00000024:1.0:1787381350.740988:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787381350.741074:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381350.741136:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065895680 00000100:00100000:2.0:1787381350.741141:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065895680 00000100:00100000:2.0:1787381350.741179:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787381350.741186:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16461b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+19:3311:x1874205065895680:12345-0@lo:400: 00000100:00100000:1.0:1787381350.741340:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065895552:12345-0@lo:13: Request processed in 387us (2404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381350.741358:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1787381350.741400:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787381350.745543:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065896064:0@lo:400: 00000100:00100000:0.0:1787381350.745618:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787381350.745715:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a6f6300 x1874205065895552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381366 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381350.745734:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065895552:0@lo:13: 00000100:00100000:1.0:1787381350.745879:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065896064 00000100:00100000:1.0:1787381350.745885:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065896064 00000100:00100000:1.0:1787381350.745943:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787381350.745953:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065896064:12345-0@lo:400: 00000100:00100000:1.0:1787381350.746036:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a803b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065896064:12345-0@lo:400: Request processed in 85us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381350.746044:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787381350.746070:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167f59d180 x1874205065896064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787381366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381350.746080:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065896064:0@lo:400: 00000100:00100000:2.0:1787381350.746506:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16461b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+19:3311:x1874205065895680:12345-0@lo:400: Request processed in 5318us (5430us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381350.746516:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787381350.746718:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd19486c-5291-4823-bb9c-f3a73416a496:3311:1874205065895680:0@lo:400: 00000100:00100000:3.0:1787381350.747327:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381350.747610:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065896192 00000100:00100000:1.0:1787381350.747618:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065896192 00000100:00100000:1.0:1787381350.747733:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787381350.747741:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874205065896192:12345-0@lo:400: 00000100:00100000:1.0:1787381350.747811:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874205065896192:12345-0@lo:400: Request processed in 71us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381350.747818:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787381350.747975:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1874205065896192:0@lo:400: 00000100:00080000:2.0:1787381350.751308:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787381351.145426:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381351.145527:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047000192 00000100:00100000:1.0:1787381351.145537:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047000192 00000100:00100000:1.0:1787381351.145614:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:1.0:1787381351.145625:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+7:5645:x1874205047000192:12345-192.168.203.22@tcp:41: 00000004:00000024:1.0:1787381351.145669:0:5792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1787381351.145746:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+7:5645:x1874205047000192:12345-192.168.203.22@tcp:41: Request processed in 122us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381351.145754:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00080000:2.0:1787381351.146048:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787381351.150296:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381351.150390:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047000320 00000100:00100000:1.0:1787381351.150400:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047000320 00000100:00100000:1.0:1787381351.150474:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:1.0:1787381351.150486:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f2157c09-10df-40cb-8228-ad4822122c97+5:5645:x1874205047000320:12345-192.168.203.22@tcp:13: 00002000:00000024:1.0:1787381351.150512:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787381351.150583:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f2157c09-10df-40cb-8228-ad4822122c97+5:5645:x1874205047000320:12345-192.168.203.22@tcp:13: Request processed in 99us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381351.150591:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00080000:2.0:1787381351.150694:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787381351.164450:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381351.164723:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047000448 00000100:00100000:1.0:1787381351.164734:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047000448 00000100:00100000:1.0:1787381351.164805:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:1.0:1787381351.164816:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f2157c09-10df-40cb-8228-ad4822122c97+6:5645:x1874205047000448:12345-192.168.203.22@tcp:13: 00002000:00000024:1.0:1787381351.164852:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787381351.164936:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f2157c09-10df-40cb-8228-ad4822122c97+6:5645:x1874205047000448:12345-192.168.203.22@tcp:13: Request processed in 122us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381351.164944:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00080000:2.0:1787381351.165086:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787381351.244573:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787381351.244600:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065896448:0@lo:13: 00000100:00100000:3.0:1787381351.244670:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381351.244778:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065896448 00000100:00100000:0.0:1787381351.244786:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065896448 00000100:00100000:0.0:1787381351.244839:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787381351.244848:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065896448:12345-0@lo:13: 00002000:00000024:0.0:1787381351.244870:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787381351.244917:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065896448:12345-0@lo:13: Request processed in 70us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381351.244925:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787381351.244961:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a803100 x1874205065896448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381367 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381351.244978:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a803100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065896448:0@lo:13: 00010000:00010000:2.0:1787381351.308236:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381352.334160:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787381352.886209:0:7481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f2157c09-10df-40cb-8228-ad4822122c97 00000001:00100000:2.0:1787381352.912329:0:5813:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f2157c09-10df-40cb-8228-ad4822122c97 00010000:00010000:2.0:1787381353.356194:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787381353.607813:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381353.607857:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381353.607893:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381353.607896:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047000704 00000100:00100000:1.0:1787381353.607907:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047000704 00000100:00100000:3.0:1787381353.607952:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381353.607989:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047000832 00000100:00100000:1.0:1787381353.607991:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:3.0:1787381353.607994:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047000832 00000100:00100000:1.0:1787381353.608040:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+6:2349:x1874205047000704:12345-192.168.203.22@tcp:400: 00000100:00100000:3.0:1787381353.608052:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047000960 00000100:00100000:3.0:1787381353.608056:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047000960 00000100:00100000:3.0:1787381353.608080:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:3.0:1787381353.608088:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2157c09-10df-40cb-8228-ad4822122c97+5:2350:x1874205047000832:12345-192.168.203.22@tcp:400: 00000100:00100000:1.0:1787381353.608118:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+6:2349:x1874205047000704:12345-192.168.203.22@tcp:400: Request processed in 115us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381353.608125:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2157c09-10df-40cb-8228-ad4822122c97+5:2350:x1874205047000832:12345-192.168.203.22@tcp:400: Request processed in 36us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381353.608141:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:3.0:1787381353.608146:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:3.0:1787381353.608164:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00080000:1.0:1787381353.608167:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787381353.608172:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2157c09-10df-40cb-8228-ad4822122c97+5:2349:x1874205047000960:12345-192.168.203.22@tcp:400: 00000100:00080000:1.0:1787381353.608173:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787381353.608178:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787381353.608203:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2157c09-10df-40cb-8228-ad4822122c97+5:2349:x1874205047000960:12345-192.168.203.22@tcp:400: Request processed in 31us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381353.608210:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:0.0:1787381353.608265:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047000576 00000100:00100000:0.0:1787381353.608271:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047000576 00000100:00100000:0.0:1787381353.608311:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 129 00000100:00100000:0.0:1787381353.608318:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:2350:x1874205047000576:12345-192.168.203.22@tcp:400: 00000100:00100000:0.0:1787381353.608346:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:2350:x1874205047000576:12345-192.168.203.22@tcp:400: Request processed in 29us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381353.608352:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 129 00000001:02000400:0.0:1787381354.166742:0:8139:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787381354.380363:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381355.404127:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787381355.854584:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1874205065896832:0@lo:400: 00000100:00100000:2.0:1787381355.854647:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381355.854706:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787381355.854713:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874205065896704:0@lo:400: 00000100:00100000:2.0:1787381355.854734:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381355.854748:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a805c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065897216:0@lo:400: 00000100:00100000:2.0:1787381355.854767:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381355.854803:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065896832 00000100:00100000:2.0:1787381355.854810:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065896832 00000100:00100000:2.0:1787381355.854851:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065896704 00000100:00100000:2.0:1787381355.854860:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065896704 00000100:00100000:2.0:1787381355.854878:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787381355.854884:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874205065896832:12345-0@lo:400: 00000100:00100000:2.0:1787381355.854924:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a807b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874205065896832:12345-0@lo:400: Request processed in 40us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381355.854929:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787381355.854940:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787381355.854945:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874205065896704:12345-0@lo:400: 00000100:00100000:2.0:1787381355.854981:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a806a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874205065896704:12345-0@lo:400: Request processed in 35us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381355.854986:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787381355.855034:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065897216 00000100:00100000:2.0:1787381355.855037:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065897216 00000100:00100000:2.0:1787381355.855058:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787381355.855062:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065897216:12345-0@lo:400: 00000100:00100000:2.0:1787381355.855083:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065897216:12345-0@lo:400: Request processed in 21us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381355.855087:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787381355.855114:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874205065896704:0@lo:400: 00010000:00080000:2.0:1787381355.855122:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a805c00 x1874205065897216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787381371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787381355.855129:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a805c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065897216:0@lo:400: 00000100:00100000:2.0:1787381355.855133:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1874205065896832:0@lo:400: 00000100:00100000:0.0:1787381355.855220:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd19486c-5291-4823-bb9c-f3a73416a496:3311:1874205065896576:0@lo:400: 00000100:00100000:0.0:1787381355.855244:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381355.855259:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a806d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1874205065897088:0@lo:400: 00000100:00100000:0.0:1787381355.855280:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381355.855290:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787381355.855293:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a807100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065896960:0@lo:400: 00000100:00100000:0.0:1787381355.855304:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381355.856340:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065897088 00000100:00100000:1.0:1787381355.856350:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065897088 00000100:00100000:1.0:1787381355.856388:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787381355.856402:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a803100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874205065897088:12345-0@lo:400: 00000100:00100000:1.0:1787381355.856474:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a803100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874205065897088:12345-0@lo:400: Request processed in 74us (1191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381355.856480:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1787381355.856499:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787381355.856504:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787381355.856635:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a806d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1874205065897088:0@lo:400: 00000100:00100000:3.0:1787381355.856900:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065896960 00000100:00100000:3.0:1787381355.856905:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065896960 00000100:00100000:3.0:1787381355.856954:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787381355.856971:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065896960:12345-0@lo:400: 00000100:00100000:3.0:1787381355.857043:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065896960:12345-0@lo:400: Request processed in 74us (1737us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381355.857049:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1787381355.857076:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a807100 x1874205065896960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787381371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787381355.857087:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a807100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065896960:0@lo:400: 00000100:00100000:2.0:1787381355.857251:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065896576 00000100:00100000:2.0:1787381355.857256:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065896576 00000100:00100000:2.0:1787381355.857286:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787381355.857299:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+19:3311:x1874205065896576:12345-0@lo:400: 00000100:00100000:0.0:1787381355.857398:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787381355.857411:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a805c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065897344:0@lo:13: 00000100:00100000:0.0:1787381355.857443:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381355.857470:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065897344 00000100:00100000:0.0:1787381355.857474:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065897344 00000100:00100000:0.0:1787381355.857498:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787381355.857504:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065897344:12345-0@lo:13: 00002000:00000024:0.0:1787381355.857529:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787381355.857564:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a801880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065897344:12345-0@lo:13: Request processed in 60us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381355.857570:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1787381355.857592:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a805c00 x1874205065897344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381371 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381355.857603:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a805c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065897344:0@lo:13: 00000100:00100000:2.0:1787381355.858627:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+19:3311:x1874205065896576:12345-0@lo:400: Request processed in 1325us (3376us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381355.858637:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:1.0:1787381355.858726:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787381355.859399:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd19486c-5291-4823-bb9c-f3a73416a496:3311:1874205065896576:0@lo:400: 00000100:00100000:2.0:1787381356.364383:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a800a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065897472:0@lo:13: 00000100:00100000:2.0:1787381356.364455:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381356.364624:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065897472 00000100:00100000:0.0:1787381356.364633:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065897472 00000100:00100000:0.0:1787381356.364687:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787381356.364696:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065897472:12345-0@lo:13: 00002000:00000024:0.0:1787381356.364733:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787381356.364786:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a805180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065897472:12345-0@lo:13: Request processed in 90us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381356.364809:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1787381356.364892:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a800a80 x1874205065897472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381372 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787381356.364909:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a800a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065897472:0@lo:13: 00010000:00010000:3.0:1787381356.428445:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381357.453688:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381358.499595:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787381358.746182:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381358.746289:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381358.746305:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047001088 00000100:00100000:1.0:1787381358.746315:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047001088 00000100:00100000:0.0:1787381358.746324:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381358.746358:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381358.746370:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 131 00000100:00100000:1.0:1787381358.746382:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:2352:x1874205047001088:12345-192.168.203.22@tcp:400: 00000100:00100000:0.0:1787381358.746387:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047001216 00000100:00100000:0.0:1787381358.746392:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047001216 00000100:00100000:2.0:1787381358.746607:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047001344 00000100:00100000:2.0:1787381358.746613:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047001344 00000100:00100000:2.0:1787381358.746650:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047001472 00000100:00100000:2.0:1787381358.746653:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047001472 00000100:00100000:2.0:1787381358.746678:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:2.0:1787381358.746686:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2157c09-10df-40cb-8228-ad4822122c97+5:2352:x1874205047001344:12345-192.168.203.22@tcp:400: 00000100:00100000:1.0:1787381358.746750:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:2352:x1874205047001088:12345-192.168.203.22@tcp:400: Request processed in 371us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381358.746758:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 131 00000100:00100000:2.0:1787381358.746898:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2157c09-10df-40cb-8228-ad4822122c97+5:2352:x1874205047001344:12345-192.168.203.22@tcp:400: Request processed in 213us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381358.746905:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:2.0:1787381358.746920:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:2.0:1787381358.746927:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16461ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2157c09-10df-40cb-8228-ad4822122c97+5:2352:x1874205047001472:12345-192.168.203.22@tcp:400: 00000100:00100000:2.0:1787381358.747123:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16461ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2157c09-10df-40cb-8228-ad4822122c97+5:2352:x1874205047001472:12345-192.168.203.22@tcp:400: Request processed in 196us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381358.747130:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00080000:1.0:1787381358.748178:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787381358.748185:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787381358.748189:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787381358.748626:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 27 00000100:00100000:0.0:1787381358.748638:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16461ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+6:2352:x1874205047001216:12345-192.168.203.22@tcp:400: 00000100:00100000:0.0:1787381358.748710:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16461ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+6:2352:x1874205047001216:12345-192.168.203.22@tcp:400: Request processed in 76us (2386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381358.748717:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 27 00000020:00000080:1.0:1787381358.825831:0:8287:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffd04b92d10 00000020:00000080:1.0:1787381358.825848:0:8287:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:1.0:1787381358.825853:0:8287:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:1.0:1787381358.825862:0:8287:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd04b94fa0 20000000:00000080:1.0:1787381358.825878:0:8287:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a167f4de000 uarg=0000000000000000 20000000:01000000:1.0:1787381358.825930:0:8287:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1787381358.825933:0:8287:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1787381358.825948:0:8287:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787381358.825954:0:8287:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1787381358.825959:0:8287:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1787381358.825974:0:8287:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787381358.825976:0:8287:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787381358.828677:0:8287:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787381358.828685:0:8287:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787381358.829778:0:8288:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1787381358.836407:0:8287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1787381358.836468:0:8287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1787381358.836501:0:8287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1787381358.836518:0:8287:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787381358.836521:0:8287:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787381358.842386:0:8289:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1787381358.842913:0:8287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1787381358.842993:0:8287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1787381358.843252:0:8287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1787381358.843269:0:8287:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787381358.843272:0:8287:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787381358.847537:0:8290:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1787381358.848486:0:8287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1787381358.848539:0:8287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1787381358.848596:0:8287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1787381358.848609:0:8287:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787381358.848612:0:8287:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787381358.849770:0:8291:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1787381358.850609:0:8287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1787381358.850675:0:8287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1787381358.850793:0:8287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:3.0:1787381358.850811:0:8287:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787381358.850830:0:8287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a168216da00/0xbdc38ada7ea0f931 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381358.850848:0:8287:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a16413a1800/0xbdc38ada7ea0f82e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f827 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381358.850856:0:8287:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a16413a1400/0xbdc38ada7ea0f858 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f851 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381358.850862:0:8287:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a16413a1600/0xbdc38ada7ea0f882 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f87b expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381358.850869:0:8287:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a1640031000/0xbdc38ada7ea0f890 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f889 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381358.850883:0:8287:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a168216dc00/0xbdc38ada7ea0f89e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f897 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381358.850890:0:8287:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a1541389e00/0xbdc38ada7ea0f8ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f8b3 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381358.850896:0:8287:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a164166b000/0xbdc38ada7ea0f8e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f8dd expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381358.850906:0:8287:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a1541389a00/0xbdc38ada7ea0f8f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9535bb expref: 9 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381358.850913:0:8287:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a164166b400/0xbdc38ada7ea0f8f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9535c2 expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381358.850921:0:8287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a168216da00/0xbdc38ada7ea0f931 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381358.851220:0:8287:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a164166b400/0xbdc38ada7ea0f8f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9535c2 expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381358.851236:0:8287:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a164166b400/0xbdc38ada7ea0f8f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9535c2 expref: 9 pid: 5784 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381358.851250:0:8287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8287:1874205065897600:192.168.203.22@tcp:104: 00010000:00010000:3.0:1787381358.851385:0:8287:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a1541389a00/0xbdc38ada7ea0f8f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9535bb expref: 9 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381358.851394:0:8287:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a1541389a00/0xbdc38ada7ea0f8f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9535bb expref: 9 pid: 5783 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381358.851410:0:8287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8287:1874205065897728:192.168.203.22@tcp:104: 00010000:00010000:3.0:1787381358.851443:0:8287:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a164166b000/0xbdc38ada7ea0f8e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbdc38ada7ea0f8dd expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381358.851451:0:8287:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a164166b000/0xbdc38ada7ea0f8e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f8dd expref: 18 pid: 5785 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381358.851459:0:8287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8287:1874205065897856:0@lo:104: 00000100:00100000:3.0:1787381358.851506:0:8287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787381358.851544:0:8287:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a1541389e00/0xbdc38ada7ea0f8ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbdc38ada7ea0f8b3 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381358.851552:0:8287:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a1541389e00/0xbdc38ada7ea0f8ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f8b3 expref: 18 pid: 5783 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381358.851560:0:8287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6bbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8287:1874205065897984:0@lo:104: 00000100:00100000:3.0:1787381358.851580:0:8287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787381358.851608:0:8287:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a168216dc00/0xbdc38ada7ea0f89e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbdc38ada7ea0f897 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381358.851616:0:8287:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a168216dc00/0xbdc38ada7ea0f89e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f897 expref: 18 pid: 5784 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381358.851624:0:8287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6baa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8287:1874205065898112:0@lo:104: 00010000:00010000:3.0:1787381358.851646:0:8287:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a1640031000/0xbdc38ada7ea0f890 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbdc38ada7ea0f889 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381358.851653:0:8287:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a1640031000/0xbdc38ada7ea0f890 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f889 expref: 18 pid: 5784 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381358.851666:0:8287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6b8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8287:1874205065898240:0@lo:104: 00010000:00010000:3.0:1787381358.851688:0:8287:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a16413a1600/0xbdc38ada7ea0f882 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbdc38ada7ea0f87b expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381358.851695:0:8287:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a16413a1600/0xbdc38ada7ea0f882 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f87b expref: 18 pid: 5785 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381358.851702:0:8287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6b9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8287:1874205065898368:0@lo:104: 00010000:00010000:3.0:1787381358.851962:0:8287:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a16413a1400/0xbdc38ada7ea0f858 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbdc38ada7ea0f851 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381358.851970:0:8287:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a16413a1400/0xbdc38ada7ea0f858 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f851 expref: 18 pid: 5785 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381358.851978:0:8287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6b8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8287:1874205065898496:0@lo:104: 00010000:00010000:3.0:1787381358.852000:0:8287:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a16413a1800/0xbdc38ada7ea0f82e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbdc38ada7ea0f827 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381358.852033:0:8287:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a16413a1800/0xbdc38ada7ea0f82e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f827 expref: 18 pid: 5784 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381358.852040:0:8287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6ba680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8287:1874205065898624:0@lo:104: 00000100:00100000:3.0:1787381358.852056:0:8287:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1674d98f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787381358.852133:0:5773:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787381358.852156:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381358.852167:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381358.852174:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381358.852182:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381358.852188:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381358.852195:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065897856 00000100:00100000:2.0:1787381358.852201:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065897856 00000100:00100000:2.0:1787381358.852235:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065897984 00000100:00100000:2.0:1787381358.852238:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065897984 00000100:00100000:2.0:1787381358.852246:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065898112 00000100:00100000:2.0:1787381358.852248:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065898112 00000100:00100000:2.0:1787381358.852256:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065898240 00000100:00100000:2.0:1787381358.852258:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065898240 00000100:00100000:2.0:1787381358.852265:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065898368 00000100:00100000:2.0:1787381358.852267:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065898368 00000100:00100000:2.0:1787381358.852274:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065898496 00000100:00100000:2.0:1787381358.852276:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065898496 00000100:00100000:2.0:1787381358.852283:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065898624 00000100:00100000:2.0:1787381358.852286:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065898624 00000100:00100000:2.0:1787381358.852296:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787381358.852303:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f6b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+9:8287:x1874205065897856:12345-0@lo:104: 00010000:00010000:2.0:1787381358.852317:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9a164166a600/0xbdc38ada7ea0f8dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f8e4 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.852380:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787381358.852387:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f6b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+9:8287:x1874205065897856:12345-0@lo:104: Request processed in 83us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381358.852394:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787381358.852411:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787381358.852417:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f542850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+8:8287:x1874205065897984:12345-0@lo:104: 00010000:00010000:2.0:1787381358.852424:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9a16413a0a00/0xbdc38ada7ea0f8b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f8ba expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.852464:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787381358.852470:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f542850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+8:8287:x1874205065897984:12345-0@lo:104: Request processed in 54us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381358.852476:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787381358.852509:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787381358.852517:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a804380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+7:8287:x1874205065898112:12345-0@lo:104: 00010000:00010000:2.0:1787381358.852525:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9a1640031e00/0xbdc38ada7ea0f897 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f89e expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.852550:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787381358.852554:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a804380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+7:8287:x1874205065898112:12345-0@lo:104: Request processed in 39us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381358.852560:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787381358.852571:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787381358.852576:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a806680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+6:8287:x1874205065898240:12345-0@lo:104: 00010000:00010000:2.0:1787381358.852582:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9a1640030a00/0xbdc38ada7ea0f889 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f890 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.852605:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787381358.852610:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a806680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+6:8287:x1874205065898240:12345-0@lo:104: Request processed in 34us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381358.852615:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787381358.852626:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787381358.852631:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a805500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+5:8287:x1874205065898368:12345-0@lo:104: 00010000:00010000:2.0:1787381358.852638:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9a1640030800/0xbdc38ada7ea0f87b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f882 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.852667:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1787381358.852673:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a805500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+5:8287:x1874205065898368:12345-0@lo:104: Request processed in 42us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381358.852678:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787381358.852689:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787381358.852695:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a804000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+4:8287:x1874205065898496:12345-0@lo:104: 00010000:00010000:2.0:1787381358.852702:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9a164166ba00/0xbdc38ada7ea0f851 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f858 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.852726:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1787381358.852730:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a804000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+4:8287:x1874205065898496:12345-0@lo:104: Request processed in 36us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381358.852735:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787381358.852745:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787381358.852751:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a806300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+3:8287:x1874205065898624:12345-0@lo:104: 00010000:00010000:2.0:1787381358.852759:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9a164166a000/0xbdc38ada7ea0f827 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f82e expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.852782:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1787381358.852787:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a806300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+3:8287:x1874205065898624:12345-0@lo:104: Request processed in 37us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381358.852792:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1787381358.852812:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1787381358.852817:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a164166a600/0xbdc38ada7ea0f8dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f8e4 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.852825:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a164166a600 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:2.0:1787381358.852835:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a164166a600/0xbdc38ada7ea0f8dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xbdc38ada7ea0f8e4 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.852844:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a164166a600/0xbdc38ada7ea0f8dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xbdc38ada7ea0f8e4 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787381358.852851:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a164166a600/0xbdc38ada7ea0f8dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xbdc38ada7ea0f8e4 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787381358.852858:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787381358.852889:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a164166a600/0xbdc38ada7ea0f8dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f8e4 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.852896:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787381358.852915:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a164166a600/0xbdc38ada7ea0f8dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f8e4 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.852922:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a164166a600/0xbdc38ada7ea0f8dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f8e4 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.852951:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1787381358.852955:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a16413a0a00/0xbdc38ada7ea0f8b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f8ba expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.852960:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a0a00 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:2.0:1787381358.852963:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a16413a0a00/0xbdc38ada7ea0f8b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xbdc38ada7ea0f8ba expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.852972:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a16413a0a00/0xbdc38ada7ea0f8b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xbdc38ada7ea0f8ba expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787381358.852988:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a16413a0a00/0xbdc38ada7ea0f8b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xbdc38ada7ea0f8ba expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787381358.852992:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787381358.853032:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a16413a0a00/0xbdc38ada7ea0f8b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f8ba expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.853038:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787381358.853053:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a16413a0a00/0xbdc38ada7ea0f8b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f8ba expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.853059:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a16413a0a00/0xbdc38ada7ea0f8b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f8ba expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.853069:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787381358.853072:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a1640031e00/0xbdc38ada7ea0f897 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f89e expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.853077:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1640031e00 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:2.0:1787381358.853080:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a1640031e00/0xbdc38ada7ea0f897 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xbdc38ada7ea0f89e expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.853086:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a1640031e00/0xbdc38ada7ea0f897 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xbdc38ada7ea0f89e expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787381358.853091:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a1640031e00/0xbdc38ada7ea0f897 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xbdc38ada7ea0f89e expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787381358.853096:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787381358.853116:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a1640031e00/0xbdc38ada7ea0f897 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f89e expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.853122:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787381358.853127:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a1640031e00/0xbdc38ada7ea0f897 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f89e expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.853132:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a1640031e00/0xbdc38ada7ea0f897 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f89e expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.853140:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787381358.853143:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a1640030a00/0xbdc38ada7ea0f889 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f890 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.853148:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1640030a00 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:2.0:1787381358.853150:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a1640030a00/0xbdc38ada7ea0f889 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbdc38ada7ea0f890 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.853155:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a1640030a00/0xbdc38ada7ea0f889 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbdc38ada7ea0f890 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787381358.853161:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a1640030a00/0xbdc38ada7ea0f889 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbdc38ada7ea0f890 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787381358.853165:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787381358.853174:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a1640030a00/0xbdc38ada7ea0f889 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f890 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.853180:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787381358.853185:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a1640030a00/0xbdc38ada7ea0f889 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f890 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.853200:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a1640030a00/0xbdc38ada7ea0f889 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f890 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.853208:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787381358.853211:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a1640030800/0xbdc38ada7ea0f87b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f882 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.853217:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1640030800 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:2.0:1787381358.853219:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a1640030800/0xbdc38ada7ea0f87b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbdc38ada7ea0f882 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.853225:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a1640030800/0xbdc38ada7ea0f87b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbdc38ada7ea0f882 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787381358.853231:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a1640030800/0xbdc38ada7ea0f87b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbdc38ada7ea0f882 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787381358.853236:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787381358.853248:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a1640030800/0xbdc38ada7ea0f87b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f882 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.853254:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787381358.853258:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a1640030800/0xbdc38ada7ea0f87b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f882 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.853264:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a1640030800/0xbdc38ada7ea0f87b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f882 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.853273:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787381358.853284:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a164166ba00/0xbdc38ada7ea0f851 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f858 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.853291:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a164166ba00 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:2.0:1787381358.853293:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a164166ba00/0xbdc38ada7ea0f851 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbdc38ada7ea0f858 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.853299:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a164166ba00/0xbdc38ada7ea0f851 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbdc38ada7ea0f858 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787381358.853305:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a164166ba00/0xbdc38ada7ea0f851 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbdc38ada7ea0f858 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787381358.853310:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787381358.853325:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a164166ba00/0xbdc38ada7ea0f851 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f858 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.853330:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787381358.853333:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a164166ba00/0xbdc38ada7ea0f851 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f858 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.853339:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a164166ba00/0xbdc38ada7ea0f851 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f858 expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.853347:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787381358.853350:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a164166a000/0xbdc38ada7ea0f827 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f82e expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.853354:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a164166a000 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:2.0:1787381358.853356:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a164166a000/0xbdc38ada7ea0f827 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbdc38ada7ea0f82e expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.853373:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a164166a000/0xbdc38ada7ea0f827 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbdc38ada7ea0f82e expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787381358.853378:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a164166a000/0xbdc38ada7ea0f827 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbdc38ada7ea0f82e expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787381358.853384:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787381358.853397:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a164166a000/0xbdc38ada7ea0f827 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f82e expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.853401:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787381358.853405:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a164166a000/0xbdc38ada7ea0f827 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f82e expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.853411:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a164166a000/0xbdc38ada7ea0f827 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f82e expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.853424:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381358.853426:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381358.853427:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381358.853435:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787381358.853455:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a805f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd19486c-5291-4823-bb9c-f3a73416a496:3311:1874205065898752:0@lo:103: 00000100:00100000:2.0:1787381358.853492:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381358.853514:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd19486c-5291-4823-bb9c-f3a73416a496:3311:1874205065899264:0@lo:103: 00000100:00100000:2.0:1787381358.853532:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381358.853552:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787381358.853559:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd19486c-5291-4823-bb9c-f3a73416a496:3311:1874205065899136:0@lo:103: 00000100:00100000:2.0:1787381358.853578:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381358.853612:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a804700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065898880:0@lo:103: 00000100:00100000:2.0:1787381358.853635:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381358.853645:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a804a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065899392:0@lo:103: 00000100:00100000:2.0:1787381358.853659:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381358.853668:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787381358.853673:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065899008:0@lo:103: 00000100:00100000:2.0:1787381358.853687:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381358.853695:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a805c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065899520:0@lo:103: 00000100:00100000:2.0:1787381358.853710:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381358.853731:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065898752 00000100:00100000:2.0:1787381358.853736:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065898752 00010000:00010000:2.0:1787381358.853756:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a164166b000/0xbdc38ada7ea0f8e4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f8dd expref: 19 pid: 5785 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381358.853772:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065899264 00000100:00100000:2.0:1787381358.853774:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065899264 00010000:00010000:2.0:1787381358.853782:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a16413a1600/0xbdc38ada7ea0f882 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f87b expref: 20 pid: 5785 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381358.853790:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065899136 00000100:00100000:2.0:1787381358.853792:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065899136 00010000:00010000:2.0:1787381358.853799:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a1640031000/0xbdc38ada7ea0f890 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f889 expref: 21 pid: 5784 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381358.853807:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065898880 00000100:00100000:2.0:1787381358.853809:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065898880 00010000:00010000:2.0:1787381358.853815:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a1541389e00/0xbdc38ada7ea0f8ba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f8b3 expref: 22 pid: 5783 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381358.853823:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065899392 00000100:00100000:2.0:1787381358.853830:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065899392 00010000:00010000:2.0:1787381358.853839:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a16413a1400/0xbdc38ada7ea0f858 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f851 expref: 23 pid: 5785 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381358.853849:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065899008 00000100:00100000:2.0:1787381358.853851:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065899008 00010000:00010000:2.0:1787381358.853858:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a168216dc00/0xbdc38ada7ea0f89e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f897 expref: 24 pid: 5784 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381358.853866:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065899520 00000100:00100000:2.0:1787381358.853868:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065899520 00010000:00010000:2.0:1787381358.853876:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a16413a1800/0xbdc38ada7ea0f82e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f827 expref: 25 pid: 5784 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381358.853887:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787381358.853894:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a807100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd19486c-5291-4823-bb9c-f3a73416a496+25:3311:x1874205065898752:12345-0@lo:103: 00010000:00010000:2.0:1787381358.853903:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381358.853909:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a164166b000/0xbdc38ada7ea0f8e4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f8dd expref: 25 pid: 5785 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.853917:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a164166b000/0xbdc38ada7ea0f8e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f8dd expref: 25 pid: 5785 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.853932:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787381358.853978:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a807100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd19486c-5291-4823-bb9c-f3a73416a496+25:3311:x1874205065898752:12345-0@lo:103: Request processed in 83us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381358.853984:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787381358.853999:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787381358.854028:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a806d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd19486c-5291-4823-bb9c-f3a73416a496+24:3311:x1874205065899264:12345-0@lo:103: 00010000:00010000:2.0:1787381358.854035:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381358.854046:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a16413a1600/0xbdc38ada7ea0f882 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f87b expref: 24 pid: 5785 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.854054:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a16413a1600/0xbdc38ada7ea0f882 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f87b expref: 24 pid: 5785 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.854064:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787381358.854086:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a806d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd19486c-5291-4823-bb9c-f3a73416a496+24:3311:x1874205065899264:12345-0@lo:103: Request processed in 61us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381358.854093:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787381358.854106:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787381358.854112:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a33ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd19486c-5291-4823-bb9c-f3a73416a496+23:3311:x1874205065899136:12345-0@lo:103: 00010000:00010000:2.0:1787381358.854119:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381358.854123:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a1640031000/0xbdc38ada7ea0f890 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f889 expref: 23 pid: 5784 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.854131:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a1640031000/0xbdc38ada7ea0f890 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f889 expref: 23 pid: 5784 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.854139:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787381358.854159:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a33ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd19486c-5291-4823-bb9c-f3a73416a496+23:3311:x1874205065899136:12345-0@lo:103: Request processed in 47us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381358.854164:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787381358.854175:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787381358.854180:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd19486c-5291-4823-bb9c-f3a73416a496+22:3308:x1874205065898880:12345-0@lo:103: 00010000:00010000:2.0:1787381358.854186:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381358.854189:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a1541389e00/0xbdc38ada7ea0f8ba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f8b3 expref: 22 pid: 5783 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.854210:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a1541389e00/0xbdc38ada7ea0f8ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f8b3 expref: 22 pid: 5783 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.854219:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787381358.854247:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd19486c-5291-4823-bb9c-f3a73416a496+22:3308:x1874205065898880:12345-0@lo:103: Request processed in 66us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381358.854254:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787381358.854267:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787381358.854272:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd19486c-5291-4823-bb9c-f3a73416a496+21:3308:x1874205065899392:12345-0@lo:103: 00010000:00010000:2.0:1787381358.854279:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381358.854283:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a16413a1400/0xbdc38ada7ea0f858 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f851 expref: 21 pid: 5785 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.854291:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a16413a1400/0xbdc38ada7ea0f858 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f851 expref: 21 pid: 5785 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.854300:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787381358.854319:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd19486c-5291-4823-bb9c-f3a73416a496+21:3308:x1874205065899392:12345-0@lo:103: Request processed in 47us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381358.854325:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787381358.854336:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787381358.854341:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd19486c-5291-4823-bb9c-f3a73416a496+20:3308:x1874205065899008:12345-0@lo:103: 00010000:00010000:2.0:1787381358.854348:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381358.854352:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a168216dc00/0xbdc38ada7ea0f89e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f897 expref: 20 pid: 5784 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.854360:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a168216dc00/0xbdc38ada7ea0f89e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f897 expref: 20 pid: 5784 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.854378:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787381358.854400:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd19486c-5291-4823-bb9c-f3a73416a496+20:3308:x1874205065899008:12345-0@lo:103: Request processed in 59us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381358.854405:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787381358.854417:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787381358.854422:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166d05e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd19486c-5291-4823-bb9c-f3a73416a496+19:3308:x1874205065899520:12345-0@lo:103: 00010000:00010000:2.0:1787381358.854429:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381358.854433:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a16413a1800/0xbdc38ada7ea0f82e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f827 expref: 19 pid: 5784 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.854442:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a16413a1800/0xbdc38ada7ea0f82e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f827 expref: 19 pid: 5784 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.854451:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787381358.854471:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166d05e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd19486c-5291-4823-bb9c-f3a73416a496+19:3308:x1874205065899520:12345-0@lo:103: Request processed in 49us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381358.854477:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787381358.854532:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065899008:0@lo:103: 00000100:00100000:2.0:1787381358.854540:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a805c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065899520:0@lo:103: 00000100:00100000:2.0:1787381358.854547:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a804700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065898880:0@lo:103: 00000100:00100000:2.0:1787381358.854554:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a804a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065899392:0@lo:103: 00000100:00100000:2.0:1787381358.854582:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a807800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd19486c-5291-4823-bb9c-f3a73416a496:3311:1874205065899136:0@lo:103: 00000100:00100000:2.0:1787381358.854588:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a805f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd19486c-5291-4823-bb9c-f3a73416a496:3311:1874205065898752:0@lo:103: 00000100:00100000:2.0:1787381358.854594:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a805880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd19486c-5291-4823-bb9c-f3a73416a496:3311:1874205065899264:0@lo:103: 00010000:00010000:3.0:1787381358.854730:0:8287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a164166b000/0xbdc38ada7ea0f8e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbdc38ada7ea0f8dd expref: 18 pid: 5785 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381358.854742:0:8287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8287:1874205065897856:0@lo:104: 00010000:00010000:3.0:1787381358.854752:0:8287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1541389e00/0xbdc38ada7ea0f8ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbdc38ada7ea0f8b3 expref: 17 pid: 5783 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381358.854768:0:8287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6bbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8287:1874205065897984:0@lo:104: 00010000:00010000:3.0:1787381358.854784:0:8287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a168216dc00/0xbdc38ada7ea0f89e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbdc38ada7ea0f897 expref: 16 pid: 5784 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381358.854791:0:8287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6baa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8287:1874205065898112:0@lo:104: 00010000:00010000:3.0:1787381358.854798:0:8287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1640031000/0xbdc38ada7ea0f890 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbdc38ada7ea0f889 expref: 15 pid: 5784 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381358.854806:0:8287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6b8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8287:1874205065898240:0@lo:104: 00010000:00010000:3.0:1787381358.854815:0:8287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a16413a1600/0xbdc38ada7ea0f882 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbdc38ada7ea0f87b expref: 14 pid: 5785 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381358.854824:0:8287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6b9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8287:1874205065898368:0@lo:104: 00010000:00010000:3.0:1787381358.854833:0:8287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a16413a1400/0xbdc38ada7ea0f858 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbdc38ada7ea0f851 expref: 13 pid: 5785 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381358.854840:0:8287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6b8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8287:1874205065898496:0@lo:104: 00010000:00010000:3.0:1787381358.854848:0:8287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a16413a1800/0xbdc38ada7ea0f82e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbdc38ada7ea0f827 expref: 12 pid: 5784 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381358.854854:0:8287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6ba680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8287:1874205065898624:0@lo:104: 00000100:00100000:1.0:1787381358.862059:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381358.862089:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381358.862183:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047001600 00000100:00100000:2.0:1787381358.862193:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047001600 00010000:00010000:2.0:1787381358.862232:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a164166b400/0xbdc38ada7ea0f8f9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9535c2 expref: 10 pid: 5784 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381358.862266:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047001728 00000100:00100000:2.0:1787381358.862270:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047001728 00010000:00010000:2.0:1787381358.862281:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a1541389a00/0xbdc38ada7ea0f8f2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9535bb expref: 11 pid: 5783 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381358.862295:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:2.0:1787381358.862304:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c93c8548-229c-4d2f-8357-13904b6fe0fb+11:2350:x1874205047001600:12345-192.168.203.22@tcp:103: 00010000:00010000:2.0:1787381358.862317:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381358.862324:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a164166b400/0xbdc38ada7ea0f8f9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9535c2 expref: 11 pid: 5784 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.862335:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a164166b400/0xbdc38ada7ea0f8f9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9535c2 expref: 11 pid: 5784 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.862353:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787381358.862402:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c93c8548-229c-4d2f-8357-13904b6fe0fb+11:2350:x1874205047001600:12345-192.168.203.22@tcp:103: Request processed in 98us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381358.862410:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:2.0:1787381358.862427:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:2.0:1787381358.862432:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:2350:x1874205047001728:12345-192.168.203.22@tcp:103: 00010000:00010000:2.0:1787381358.862439:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381358.862443:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a1541389a00/0xbdc38ada7ea0f8f2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9535bb expref: 10 pid: 5783 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.862467:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a1541389a00/0xbdc38ada7ea0f8f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9535bb expref: 10 pid: 5783 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.862480:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a168216da00/0xbdc38ada7ea0f931 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.862489:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a168216da00/0xbdc38ada7ea0f931 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.862503:0:5777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a168216da00/0xbdc38ada7ea0f931 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.862511:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a168216da00/0xbdc38ada7ea0f931 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.862517:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a168216da00/0xbdc38ada7ea0f931 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.862523:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a168216da00/0xbdc38ada7ea0f931 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.862529:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a168216da00 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:2.0:1787381358.862534:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a168216da00/0xbdc38ada7ea0f931 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.862541:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a168216da00/0xbdc38ada7ea0f931 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.862549:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a168216da00/0xbdc38ada7ea0f931 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381358.862569:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787381358.862589:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:2350:x1874205047001728:12345-192.168.203.22@tcp:103: Request processed in 156us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381358.862596:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 20 00010000:00010000:3.0:1787381358.863316:0:8287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a164166b400/0xbdc38ada7ea0f8f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9535c2 expref: 9 pid: 5784 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381358.863332:0:8287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8287:1874205065897600:192.168.203.22@tcp:104: 00010000:00010000:3.0:1787381358.863343:0:8287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1541389a00/0xbdc38ada7ea0f8f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9535bb expref: 8 pid: 5783 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381358.863362:0:8287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8287:1874205065897728:192.168.203.22@tcp:104: 00010000:00010000:3.0:1787381358.863404:0:8287:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a168216da00/0xbdc38ada7ea0f931 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381358.863414:0:8287:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a168216da00/0xbdc38ada7ea0f931 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381358.863421:0:8287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a168216da00/0xbdc38ada7ea0f931 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381358.863427:0:8287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a168216da00/0xbdc38ada7ea0f931 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381359.501313:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787381360.332052:0:5787:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787381360.332060:0:5787:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a16436a3000 from 39 10000000:01000000:2.0:1787381360.332066:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787381360.332117:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1681733600/0xbdc38ada7ea0f938 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381360.332129:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a1681733600/0xbdc38ada7ea0f938 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381360.332141:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a1681733600/0xbdc38ada7ea0f938 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381360.332164:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065899648:0@lo:101: 00000100:00100000:2.0:1787381360.332237:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381360.332362:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fbac3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787381360.335018:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065899648 00000100:00100000:0.0:1787381360.335036:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065899648 00000100:00100000:0.0:1787381360.335175:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787381360.335186:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+12:5787:x1874205065899648:12345-0@lo:101: 00010000:00010000:0.0:1787381360.335206:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381360.335227:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1640030c00/0xbdc38ada7ea0f93f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0f938 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381360.335256:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1640030c00/0xbdc38ada7ea0f93f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f938 expref: 13 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381360.335286:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1640030c00/0xbdc38ada7ea0f93f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f938 expref: 13 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381360.335296:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1640030c00, rc 0) 00000100:00100000:0.0:1787381360.335376:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+13:5787:x1874205065899648:12345-0@lo:101: Request processed in 191us (3138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381360.335382:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787381360.336126:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065899648:0@lo:101: 00010000:00010000:2.0:1787381360.336145:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a1681733600/0xbdc38ada7ea0f938 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f93f expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381360.336156:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a1681733600/0xbdc38ada7ea0f938 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f93f expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381360.336231:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065899776:0@lo:501: 00000100:00100000:2.0:1787381360.336284:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381360.341693:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fbac3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787381360.342207:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065899776 00000100:00100000:1.0:1787381360.342218:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065899776 00000100:00100000:1.0:1787381360.342269:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787381360.342279:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+13:5787:x1874205065899776:12345-0@lo:501: 00000100:00100000:1.0:1787381360.342569:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+13:5787:x1874205065899776:12345-0@lo:501: Request processed in 290us (6283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381360.342576:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787381360.342711:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065899776:0@lo:501: 00000100:00100000:2.0:1787381360.342758:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065899904:0@lo:503: 00000100:00100000:2.0:1787381360.342805:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381360.342953:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fbac3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787381360.342993:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065899904 00000100:00100000:3.0:1787381360.342998:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065899904 00000100:00100000:1.0:1787381360.343228:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787381360.343237:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+13:5787:x1874205065899904:12345-0@lo:503: 00000100:00100000:1.0:1787381360.343392:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+13:5787:x1874205065899904:12345-0@lo:503: Request processed in 156us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381360.343399:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787381360.343481:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065899904:0@lo:503: 00000100:00100000:0.0:1787381360.343804:0:8303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461eca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:8303:1874205065900032:0@lo:502: 00000100:00100000:0.0:1787381360.343841:0:8303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381360.343946:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065900032 00000100:00100000:2.0:1787381360.343950:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065900032 00000100:00100000:2.0:1787381360.343980:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787381360.343987:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+13:8303:x1874205065900032:12345-0@lo:502: 00000100:00100000:2.0:1787381360.344158:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+13:8303:x1874205065900032:12345-0@lo:502: Request processed in 170us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381360.344165:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787381360.344285:0:8303:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167a7d69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787381360.344301:0:8303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461eca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:8303:1874205065900032:0@lo:502: 00000100:00100000:0.0:1787381360.344337:0:8303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461eca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:8303:1874205065900160:0@lo:502: 00000100:00100000:0.0:1787381360.344370:0:8303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381360.344394:0:8303:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167a7d69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787381360.344471:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065900160 00000100:00100000:2.0:1787381360.344475:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065900160 00000100:00100000:2.0:1787381360.344505:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787381360.344512:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+13:8303:x1874205065900160:12345-0@lo:502: 00000100:00100000:2.0:1787381360.344641:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+13:8303:x1874205065900160:12345-0@lo:502: Request processed in 128us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381360.344647:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787381360.344760:0:8303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461eca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:8303:1874205065900160:0@lo:502: 00000040:00080000:0.0:1787381360.344780:0:8303:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787381360.345024:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787381360.345044:0:5787:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787381360.345053:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1681733600/0xbdc38ada7ea0f938 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f93f expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381360.345076:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a1681733600/0xbdc38ada7ea0f938 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f93f expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787381360.345085:0:5787:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1787381360.345088:0:5787:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1787381360.345091:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787381360.345116:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1681732c00/0xbdc38ada7ea0f946 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381360.345123:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a1681732c00/0xbdc38ada7ea0f946 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381360.345132:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a1681732c00/0xbdc38ada7ea0f946 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381360.345145:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065900288:0@lo:101: 00000100:00100000:2.0:1787381360.345172:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381360.345190:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fbace40 going to sleep for 11 seconds 00000100:00100000:0.0:1787381360.345260:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065900288 00000100:00100000:0.0:1787381360.345265:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065900288 00000100:00100000:0.0:1787381360.345340:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787381360.345349:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+13:5787:x1874205065900288:12345-0@lo:101: 00010000:00010000:0.0:1787381360.345358:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381360.345370:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1640031400/0xbdc38ada7ea0f94d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0f946 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381360.345391:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1640031400/0xbdc38ada7ea0f94d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f946 expref: 14 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381360.345409:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1640031400/0xbdc38ada7ea0f94d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f946 expref: 14 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381360.345418:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1640031400, rc 0) 00000100:00100000:0.0:1787381360.345449:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+14:5787:x1874205065900288:12345-0@lo:101: Request processed in 102us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381360.345456:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787381360.345536:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065900288:0@lo:101: 00010000:00010000:2.0:1787381360.345548:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a1681732c00/0xbdc38ada7ea0f946 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f94d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381360.345557:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a1681732c00/0xbdc38ada7ea0f946 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f94d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381360.345596:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065900416:0@lo:501: 00000100:00100000:2.0:1787381360.345620:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381360.345657:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fbace40 going to sleep for 11 seconds 00000100:00100000:3.0:1787381360.345721:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065900416 00000100:00100000:3.0:1787381360.345726:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065900416 00000100:00100000:3.0:1787381360.345745:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787381360.345751:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+14:5787:x1874205065900416:12345-0@lo:501: 00000100:00100000:3.0:1787381360.346063:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+14:5787:x1874205065900416:12345-0@lo:501: Request processed in 311us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381360.346071:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787381360.346468:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065900416:0@lo:501: 00000100:00100000:2.0:1787381360.346495:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065900544:0@lo:503: 00000100:00100000:2.0:1787381360.346529:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381360.346557:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fbace40 going to sleep for 11 seconds 00000100:00100000:3.0:1787381360.347167:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065900544 00000100:00100000:3.0:1787381360.347174:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065900544 00000100:00100000:3.0:1787381360.347211:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787381360.347218:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+14:5787:x1874205065900544:12345-0@lo:503: 00000100:00100000:3.0:1787381360.347384:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+14:5787:x1874205065900544:12345-0@lo:503: Request processed in 166us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381360.347397:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787381360.347482:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065900544:0@lo:503: 00000100:00100000:2.0:1787381360.351246:0:8304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:8304:1874205065900672:0@lo:502: 00000100:00100000:2.0:1787381360.351336:0:8304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381360.351375:0:8304:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fbac000 going to sleep for 11 seconds 00000100:00100000:3.0:1787381360.351560:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065900672 00000100:00100000:3.0:1787381360.351568:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065900672 00000100:00100000:3.0:1787381360.351611:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787381360.351618:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+14:8304:x1874205065900672:12345-0@lo:502: 00000100:00100000:3.0:1787381360.351811:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+14:8304:x1874205065900672:12345-0@lo:502: Request processed in 192us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381360.351819:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787381360.352233:0:8304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:8304:1874205065900672:0@lo:502: 00000020:01000000:2.0:1787381360.352260:0:8304:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787381360.352269:0:8304:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787381360.352271:0:8304:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787381360.352276:0:8304:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787381360.352297:0:8304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:8304:1874205065900800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787381360.352328:0:8304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381360.352356:0:8304:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fbac000 going to sleep for 11 seconds 00000100:00100000:3.0:1787381360.352523:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065900800 00000100:00100000:3.0:1787381360.352527:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065900800 00000100:00100000:3.0:1787381360.352557:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787381360.352564:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+14:8304:x1874205065900800:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787381360.352694:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+14:8304:x1874205065900800:12345-0@lo:502:llog_process_th.0 Request processed in 130us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381360.352701:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787381360.352789:0:8304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:8304:1874205065900800:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787381360.352805:0:8304:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787381360.352809:0:8304:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787381360.352811:0:8304:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787381360.352814:0:8304:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1787381360.353134:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1787381360.353152:0:5787:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787381360.353162:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1681732c00/0xbdc38ada7ea0f946 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f94d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381360.353174:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a1681732c00/0xbdc38ada7ea0f946 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f94d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787381360.353182:0:5787:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787381360.353185:0:5787:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a1646496800 from 39 10000000:01000000:3.0:1787381360.353188:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787381360.353213:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a168216da00/0xbdc38ada7ea0f954 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381360.353229:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a168216da00/0xbdc38ada7ea0f954 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381360.353240:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a168216da00/0xbdc38ada7ea0f954 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381360.353254:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065900928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787381360.353282:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381360.353310:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1646dc3540 going to sleep for 11 seconds 00000100:00100000:0.0:1787381360.353352:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065900928 00000100:00100000:0.0:1787381360.353356:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065900928 00000100:00100000:0.0:1787381360.353386:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787381360.353393:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+14:5787:x1874205065900928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787381360.353401:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381360.353412:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1640031000/0xbdc38ada7ea0f95b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0f954 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381360.353432:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1640031000/0xbdc38ada7ea0f95b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f954 expref: 15 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381360.353442:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1640031000/0xbdc38ada7ea0f95b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f954 expref: 15 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381360.353451:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1640031000, rc 0) 00000100:00100000:0.0:1787381360.353485:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+15:5787:x1874205065900928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381360.353491:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787381360.353570:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065900928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787381360.353581:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a168216da00/0xbdc38ada7ea0f954 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f95b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381360.353590:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a168216da00/0xbdc38ada7ea0f954 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f95b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381360.353628:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065901056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787381360.353648:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381360.353666:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1646dc3540 going to sleep for 11 seconds 00000100:00100000:1.0:1787381360.354203:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065901056 00000100:00100000:1.0:1787381360.354210:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065901056 00000100:00100000:1.0:1787381360.354244:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787381360.354251:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+15:5787:x1874205065901056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787381360.354474:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+15:5787:x1874205065901056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 223us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381360.354482:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787381360.354574:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065901056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787381360.354605:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065901184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787381360.354637:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381360.354666:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1646dc3540 going to sleep for 11 seconds 00000100:00100000:2.0:1787381360.354708:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065901184 00000100:00100000:2.0:1787381360.354713:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065901184 00000100:00100000:2.0:1787381360.354741:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787381360.354748:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+15:5787:x1874205065901184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787381360.354899:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+15:5787:x1874205065901184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381360.354906:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787381360.354973:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6ba680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065901184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787381360.355820:0:8305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6ba680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:8305:1874205065901312:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787381360.355874:0:8305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381360.355908:0:8305:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1646dc3600 going to sleep for 11 seconds 00000100:00100000:0.0:1787381360.357155:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065901312 00000100:00100000:0.0:1787381360.357167:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065901312 00000100:00100000:0.0:1787381360.357227:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787381360.357237:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646169c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+15:8305:x1874205065901312:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787381360.357495:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646169c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+15:8305:x1874205065901312:12345-0@lo:502:llog_process_th.0 Request processed in 259us (1619us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381360.357503:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787381360.357602:0:8305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6ba680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:8305:1874205065901312:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787381360.357653:0:8305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:8305:1874205065901440:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787381360.357691:0:8305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381360.357720:0:8305:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1642b90d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787381360.357765:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065901440 00000100:00100000:2.0:1787381360.357768:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065901440 00000100:00100000:2.0:1787381360.357797:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787381360.357804:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+15:8305:x1874205065901440:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787381360.357967:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+15:8305:x1874205065901440:12345-0@lo:502:llog_process_th.0 Request processed in 163us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381360.357974:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787381360.358124:0:8305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:8305:1874205065901440:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787381360.358147:0:8305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787381360.360286:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787381360.360320:0:5787:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787381360.360331:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a168216da00/0xbdc38ada7ea0f954 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f95b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381360.360345:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a168216da00/0xbdc38ada7ea0f954 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f95b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787381360.360355:0:5787:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787381360.360358:0:5787:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1787381360.360361:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787381360.360398:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1681732600/0xbdc38ada7ea0f962 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381360.360405:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a1681732600/0xbdc38ada7ea0f962 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381360.360416:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a1681732600/0xbdc38ada7ea0f962 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381360.360451:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065901568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787381360.360503:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381360.360548:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fbac6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787381360.360826:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065901568 00000100:00100000:3.0:1787381360.360834:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065901568 00000100:00100000:3.0:1787381360.360878:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787381360.360885:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+15:5787:x1874205065901568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787381360.360897:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381360.360908:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a168216dc00/0xbdc38ada7ea0f969 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0f962 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381360.360940:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a168216dc00/0xbdc38ada7ea0f969 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f962 expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381360.360950:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a168216dc00/0xbdc38ada7ea0f969 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f962 expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381360.360958:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a168216dc00, rc 0) 00000100:00100000:3.0:1787381360.361027:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+16:5787:x1874205065901568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381360.361035:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787381360.363204:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065901568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787381360.363236:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a1681732600/0xbdc38ada7ea0f962 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f969 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381360.363249:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a1681732600/0xbdc38ada7ea0f962 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f969 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381360.363334:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065901696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787381360.363396:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381360.363447:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fbac6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787381360.363503:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065901696 00000100:00100000:0.0:1787381360.363510:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065901696 00000100:00100000:0.0:1787381360.363556:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787381360.363565:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+16:5787:x1874205065901696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787381360.363846:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+16:5787:x1874205065901696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 281us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381360.363854:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787381360.364086:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065901696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787381360.364116:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065901824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787381360.364157:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381360.364175:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fbac6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787381360.364447:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065901824 00000100:00100000:0.0:1787381360.364453:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065901824 00000100:00100000:0.0:1787381360.364479:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787381360.364486:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+16:5787:x1874205065901824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787381360.364645:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+16:5787:x1874205065901824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381360.364653:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787381360.364769:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065901824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787381360.365151:0:8306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:8306:1874205065901952:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787381360.365189:0:8306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381360.365223:0:8306:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fbace40 going to sleep for 11 seconds 00000100:00100000:1.0:1787381360.365262:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065901952 00000100:00100000:1.0:1787381360.365268:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065901952 00000100:00100000:1.0:1787381360.365298:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787381360.365304:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+16:8306:x1874205065901952:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787381360.365443:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+16:8306:x1874205065901952:12345-0@lo:502:llog_process_th.0 Request processed in 138us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381360.365450:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787381360.365514:0:8306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:8306:1874205065901952:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787381360.365533:0:8306:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787381360.365548:0:8306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787381360.365551:0:8306:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787381360.365556:0:8306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787381360.365575:0:8306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:8306:1874205065902080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787381360.365606:0:8306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381360.365628:0:8306:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fbace40 going to sleep for 11 seconds 00000100:00100000:3.0:1787381360.365683:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065902080 00000100:00100000:3.0:1787381360.365688:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065902080 00000100:00100000:3.0:1787381360.365718:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787381360.365725:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+16:8306:x1874205065902080:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787381360.365846:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+16:8306:x1874205065902080:12345-0@lo:502:llog_process_th.0 Request processed in 121us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381360.365853:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787381360.365953:0:8306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:8306:1874205065902080:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787381360.365971:0:8306:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787381360.365975:0:8306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787381360.365976:0:8306:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787381360.365980:0:8306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1787381360.366173:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1787381360.366202:0:5787:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787381360.366211:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1681732600/0xbdc38ada7ea0f962 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f969 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381360.366221:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a1681732600/0xbdc38ada7ea0f962 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f969 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787381360.366231:0:5787:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787381360.366233:0:5787:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a16659a7000 from 39 10000000:01000000:3.0:1787381360.366236:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787381360.366262:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a168216d200/0xbdc38ada7ea0f970 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381360.366270:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a168216d200/0xbdc38ada7ea0f970 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381360.366280:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a168216d200/0xbdc38ada7ea0f970 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381360.366292:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065902208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787381360.366320:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381360.366352:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1646dc3600 going to sleep for 11 seconds 00000100:00100000:1.0:1787381360.366390:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065902208 00000100:00100000:1.0:1787381360.366394:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065902208 00000100:00100000:1.0:1787381360.366426:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787381360.366432:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646168850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+16:5787:x1874205065902208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787381360.366440:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381360.366451:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1541389200/0xbdc38ada7ea0f977 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0f970 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381360.366471:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1541389200/0xbdc38ada7ea0f977 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f970 expref: 17 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381360.366486:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1541389200/0xbdc38ada7ea0f977 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f970 expref: 17 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381360.366494:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541389200, rc 0) 00000100:00100000:1.0:1787381360.366535:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646168850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+17:5787:x1874205065902208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381360.366542:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787381360.366705:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065902208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787381360.366716:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a168216d200/0xbdc38ada7ea0f970 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f977 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381360.366725:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a168216d200/0xbdc38ada7ea0f970 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f977 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381360.366762:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065902336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787381360.366791:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381360.366809:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1646dc3600 going to sleep for 11 seconds 00000100:00100000:1.0:1787381360.366847:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065902336 00000100:00100000:1.0:1787381360.366851:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065902336 00000100:00100000:1.0:1787381360.366877:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787381360.366883:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+17:5787:x1874205065902336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787381360.367188:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+17:5787:x1874205065902336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 304us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381360.367195:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787381360.367350:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065902336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787381360.367378:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065902464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787381360.367413:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381360.367441:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1646dc3600 going to sleep for 11 seconds 00000100:00100000:1.0:1787381360.367484:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065902464 00000100:00100000:1.0:1787381360.367488:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065902464 00000100:00100000:1.0:1787381360.367518:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787381360.367525:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+17:5787:x1874205065902464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787381360.367657:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+17:5787:x1874205065902464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381360.367664:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787381360.367743:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065902464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787381360.368252:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6b8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:8307:1874205065902592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787381360.368285:0:8307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381360.368338:0:8307:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1646dc3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787381360.374377:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065902592 00000100:00100000:2.0:1787381360.374392:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065902592 00000100:00100000:2.0:1787381360.374481:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787381360.374491:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+17:8307:x1874205065902592:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787381360.374770:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+17:8307:x1874205065902592:12345-0@lo:502:llog_process_th.0 Request processed in 277us (6480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381360.374779:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787381360.374895:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6b8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:8307:1874205065902592:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787381360.374971:0:8307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6b8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:8307:1874205065902720:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787381360.375044:0:8307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381360.376743:0:8307:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1646dc3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787381360.377030:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065902720 00000100:00100000:1.0:1787381360.377039:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065902720 00000100:00100000:1.0:1787381360.377084:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787381360.377093:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+17:8307:x1874205065902720:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787381360.377362:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+17:8307:x1874205065902720:12345-0@lo:502:llog_process_th.0 Request processed in 269us (2316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381360.377378:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787381360.377477:0:8307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6b8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:8307:1874205065902720:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787381360.377508:0:8307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787381360.377668:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787381360.377688:0:5787:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787381360.377698:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a168216d200/0xbdc38ada7ea0f970 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f977 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381360.377708:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a168216d200/0xbdc38ada7ea0f970 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f977 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787381360.377717:0:5787:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787381360.377720:0:5787:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1787381360.377723:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787381360.377761:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1541388e00/0xbdc38ada7ea0f97e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381360.377770:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a1541388e00/0xbdc38ada7ea0f97e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381360.377778:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a1541388e00/0xbdc38ada7ea0f97e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381360.377799:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065902848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787381360.377833:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381360.377863:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f596f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787381360.377988:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065902848 00000100:00100000:3.0:1787381360.377993:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065902848 00000100:00100000:3.0:1787381360.378060:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787381360.378067:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646168c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+17:5787:x1874205065902848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787381360.378077:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381360.378088:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a168216c800/0xbdc38ada7ea0f985 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0f97e expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381360.378120:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a168216c800/0xbdc38ada7ea0f985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f97e expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381360.378131:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a168216c800/0xbdc38ada7ea0f985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f97e expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381360.378138:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a168216c800, rc 0) 00000100:00100000:3.0:1787381360.378168:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646168c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+18:5787:x1874205065902848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381360.378175:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787381360.378248:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065902848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787381360.378259:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a1541388e00/0xbdc38ada7ea0f97e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f985 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381360.378278:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a1541388e00/0xbdc38ada7ea0f97e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f985 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381360.378329:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065902976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787381360.378354:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381360.378507:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f596f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787381360.378558:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065902976 00000100:00100000:2.0:1787381360.378563:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065902976 00000100:00100000:3.0:1787381360.379066:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787381360.379077:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+18:5787:x1874205065902976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787381360.379409:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+18:5787:x1874205065902976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 333us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381360.379416:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787381360.379586:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065902976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787381360.379621:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065903104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787381360.379721:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381360.379772:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f596f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787381360.380323:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065903104 00000100:00100000:3.0:1787381360.380330:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065903104 00000100:00100000:3.0:1787381360.380364:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787381360.380371:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+18:5787:x1874205065903104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787381360.380525:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+18:5787:x1874205065903104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381360.380532:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787381360.380718:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065903104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787381360.381474:0:8308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461eca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:8308:1874205065903232:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787381360.381522:0:8308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381360.381554:0:8308:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167a7d6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787381360.381592:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065903232 00000100:00100000:3.0:1787381360.381597:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065903232 00000100:00100000:3.0:1787381360.381659:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787381360.381666:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+18:8308:x1874205065903232:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787381360.381877:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+18:8308:x1874205065903232:12345-0@lo:502:llog_process_th.0 Request processed in 210us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381360.381885:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787381360.381961:0:8308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461eca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:8308:1874205065903232:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787381360.381985:0:8308:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787381360.382000:0:8308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787381360.382027:0:8308:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787381360.382034:0:8308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787381360.382052:0:8308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461eca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:8308:1874205065903360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787381360.382081:0:8308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381360.382568:0:8308:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167a7d6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787381360.382636:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065903360 00000100:00100000:1.0:1787381360.382642:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065903360 00000100:00100000:1.0:1787381360.382674:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787381360.382680:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+18:8308:x1874205065903360:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787381360.382862:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+18:8308:x1874205065903360:12345-0@lo:502:llog_process_th.0 Request processed in 181us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381360.382869:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787381360.383146:0:8308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461eca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:8308:1874205065903360:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787381360.383167:0:8308:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787381360.383172:0:8308:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787381360.383174:0:8308:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787381360.383177:0:8308:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1787381360.383494:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1787381360.383511:0:5787:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787381360.383521:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1541388e00/0xbdc38ada7ea0f97e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f985 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381360.383537:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a1541388e00/0xbdc38ada7ea0f97e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f985 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787381360.383559:0:5787:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787381360.383561:0:5787:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9a1646130000 from 1 10000000:01000000:1.0:1787381360.383564:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787381360.383588:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1541388400/0xbdc38ada7ea0f98c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381360.383596:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a1541388400/0xbdc38ada7ea0f98c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381360.383605:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a1541388400/0xbdc38ada7ea0f98c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381360.383619:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065903488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787381360.383673:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381360.383694:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f5960c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787381360.383806:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065903488 00000100:00100000:0.0:1787381360.383817:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065903488 00000100:00100000:0.0:1787381360.383840:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787381360.383846:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+18:5787:x1874205065903488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787381360.383856:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381360.383866:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1640030800/0xbdc38ada7ea0f993 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0f98c expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381360.383887:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1640030800/0xbdc38ada7ea0f993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f98c expref: 19 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381360.383896:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1640030800/0xbdc38ada7ea0f993 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f98c expref: 19 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381360.383904:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1640030800, rc 0) 00000100:00100000:0.0:1787381360.383947:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+19:5787:x1874205065903488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381360.383953:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787381360.384224:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065903488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787381360.384237:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a1541388400/0xbdc38ada7ea0f98c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f993 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381360.384245:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a1541388400/0xbdc38ada7ea0f98c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f993 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381360.384288:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065903616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787381360.384314:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381360.384336:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f5960c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787381360.384501:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065903616 00000100:00100000:0.0:1787381360.384506:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065903616 00000100:00100000:0.0:1787381360.384523:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787381360.384529:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+19:5787:x1874205065903616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787381360.384723:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+19:5787:x1874205065903616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 193us (407us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787381360.384730:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787381360.384990:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065903616:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1787381360.385038:0:5787:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787381360.385051:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1541388400/0xbdc38ada7ea0f98c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f993 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381360.385059:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a1541388400/0xbdc38ada7ea0f98c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f993 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381360.524771:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787381360.585854:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381360.586242:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047001856 00000100:00100000:1.0:1787381360.586253:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047001856 00000100:00100000:1.0:1787381360.586307:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 164 00000100:00100000:1.0:1787381360.586317:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+8:5567:x1874205047001856:12345-192.168.203.22@tcp:101: 00010000:00010000:1.0:1787381360.586332:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381360.586348:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1541388200/0xbdc38ada7ea0f99a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc01952459a953624 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381360.586374:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1541388200/0xbdc38ada7ea0f99a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953624 expref: 9 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381360.586385:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1541388200/0xbdc38ada7ea0f99a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953624 expref: 9 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381360.586405:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541388200, rc 0) 00000100:00100000:1.0:1787381360.586463:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+9:5567:x1874205047001856:12345-192.168.203.22@tcp:101: Request processed in 148us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381360.586469:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 164 00000100:00100000:2.0:1787381360.589428:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381360.589781:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047001984 00000100:00100000:1.0:1787381360.589791:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047001984 00000100:00100000:1.0:1787381360.589855:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 165 00000100:00100000:1.0:1787381360.589866:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+9:5567:x1874205047001984:12345-192.168.203.22@tcp:501: 00000100:00100000:1.0:1787381360.590205:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+9:5567:x1874205047001984:12345-192.168.203.22@tcp:501: Request processed in 339us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381360.590221:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 165 00000100:00100000:2.0:1787381360.598963:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381360.599204:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047002112 00000100:00100000:3.0:1787381360.599215:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047002112 00000100:00100000:3.0:1787381360.599276:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 166 00000100:00100000:3.0:1787381360.599287:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+9:5567:x1874205047002112:12345-192.168.203.22@tcp:503: 00000100:00100000:3.0:1787381360.599525:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+9:5567:x1874205047002112:12345-192.168.203.22@tcp:503: Request processed in 240us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381360.599534:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 166 00000100:00100000:3.0:1787381360.604494:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381360.609999:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047002240 00000100:00100000:0.0:1787381360.610050:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047002240 00000100:00100000:0.0:1787381360.610310:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 167 00000100:00100000:0.0:1787381360.610321:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+9:6039:x1874205047002240:12345-192.168.203.22@tcp:502: 00000100:00100000:0.0:1787381360.610633:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+9:6039:x1874205047002240:12345-192.168.203.22@tcp:502: Request processed in 312us (6145us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381360.610641:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 167 00000100:00100000:2.0:1787381360.625846:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381360.626057:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047002368 00000100:00100000:1.0:1787381360.626069:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047002368 00000100:00100000:1.0:1787381360.626140:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 168 00000100:00100000:1.0:1787381360.626149:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+9:6039:x1874205047002368:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787381360.626720:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+9:6039:x1874205047002368:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 570us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381360.626729:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 168 00000100:00100000:2.0:1787381360.633272:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381360.633698:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047002496 00000100:00100000:3.0:1787381360.633709:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047002496 00000100:00100000:3.0:1787381360.633825:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 169 00000100:00100000:3.0:1787381360.633852:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+9:5567:x1874205047002496:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787381360.633869:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381360.633888:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1647eb0400/0xbdc38ada7ea0f9a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc01952459a95362b expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381360.633918:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1647eb0400/0xbdc38ada7ea0f9a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95362b expref: 10 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381360.633940:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1647eb0400/0xbdc38ada7ea0f9a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95362b expref: 10 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381360.633956:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb0400, rc 0) 00000100:00100000:3.0:1787381360.634054:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:5567:x1874205047002496:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 Request processed in 219us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381360.634076:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 169 00000100:00100000:0.0:1787381360.647562:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381360.647706:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047002624 00000100:00100000:1.0:1787381360.647716:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047002624 00000100:00100000:1.0:1787381360.647774:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 170 00000100:00100000:1.0:1787381360.647785:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:5567:x1874205047002624:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787381360.648110:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:5567:x1874205047002624:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 Request processed in 325us (557us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787381360.648118:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 170 00000100:00100000:3.0:1787381360.973034:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065904128:0@lo:400:kworker.0 00000100:00100000:3.0:1787381360.973118:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381360.973185:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787381360.973191:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1874205065904000:0@lo:400:kworker.0 00000100:00100000:3.0:1787381360.973215:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381360.973246:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065904128 00000100:00100000:3.0:1787381360.973254:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065904128 00000100:00100000:3.0:1787381360.973305:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787381360.973313:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f6b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065904128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787381360.973380:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f6b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065904128:12345-0@lo:400:kworker.0 Request processed in 67us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381360.973387:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787381360.973424:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065904000 00000100:00100000:3.0:1787381360.973428:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065904000 00000100:00100000:3.0:1787381360.973454:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787381360.973461:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f6ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874205065904000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787381360.973492:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f6ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874205065904000:12345-0@lo:400:kworker.0 Request processed in 31us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381360.973498:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787381360.973530:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1874205065904000:0@lo:400:kworker.0 00010000:00080000:3.0:1787381360.973544:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167f6baa00 x1874205065904128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787381376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787381360.973554:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065904128:0@lo:400:kworker.0 00000100:00100000:0.0:1787381360.973873:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874205065903872:0@lo:400:kworker.0 00000100:00100000:0.0:1787381360.973905:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381360.973934:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065904384:0@lo:400:kworker.0 00000100:00100000:0.0:1787381360.973954:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381360.973975:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787381360.973980:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd19486c-5291-4823-bb9c-f3a73416a496:3311:1874205065903744:0@lo:400:kworker.0 00000100:00100000:0.0:1787381360.974019:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381360.974038:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1874205065904256:0@lo:400:kworker.0 00000100:00100000:0.0:1787381360.974059:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381360.974085:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065903872 00000100:00100000:0.0:1787381360.974096:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065903872 00000100:00100000:0.0:1787381360.974132:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065904256 00000100:00100000:0.0:1787381360.974135:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065904256 00000100:00100000:0.0:1787381360.974151:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787381360.974156:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16461eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874205065903872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381360.974193:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16461eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874205065903872:12345-0@lo:400:kworker.0 Request processed in 37us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381360.974199:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787381360.974211:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787381360.974217:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16461edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874205065904256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381360.974244:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16461edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874205065904256:12345-0@lo:400:kworker.0 Request processed in 27us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381360.974249:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787381360.974275:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1874205065904256:0@lo:400:kworker.0 00000100:00100000:0.0:1787381360.974285:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874205065903872:0@lo:400:kworker.0 00000100:00100000:3.0:1787381360.975239:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065903744 00000100:00100000:3.0:1787381360.975245:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065903744 00000100:00100000:3.0:1787381360.975276:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787381360.975284:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+19:3311:x1874205065903744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787381360.975331:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+19:3311:x1874205065903744:12345-0@lo:400:kworker.0 Request processed in 48us (1327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381360.975337:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787381360.975441:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065904384 00000100:00100000:2.0:1787381360.975446:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065904384 00000100:00100000:2.0:1787381360.975487:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787381360.975495:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16461eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065904384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381360.975540:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16461eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065904384:12345-0@lo:400:kworker.0 Request processed in 47us (1585us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381360.975548:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787381360.975813:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065904512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787381360.975847:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787381360.975901:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787381360.975905:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787381360.975908:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787381360.976429:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd19486c-5291-4823-bb9c-f3a73416a496:3311:1874205065903744:0@lo:400:kworker.0 00010000:00080000:0.0:1787381360.976446:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167f6b9500 x1874205065904384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787381376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381360.976459:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065904384:0@lo:400:kworker.0 00000100:00100000:2.0:1787381360.976609:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065904512 00000100:00100000:2.0:1787381360.976615:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065904512 00000100:00100000:2.0:1787381360.976662:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787381360.976670:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065904512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787381360.976707:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787381360.976758:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065904512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381360.976764:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1787381360.976908:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167f6baa00 x1874205065904512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381376 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381360.976934:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065904512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787381361.487965:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787381361.487986:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16750b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065904640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787381361.488070:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381361.488225:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065904640 00000100:00100000:0.0:1787381361.488233:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065904640 00000100:00100000:0.0:1787381361.488280:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787381361.488289:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065904640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787381361.488333:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787381361.488380:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065904640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381361.488395:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1787381361.490162:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a16750b4e00 x1874205065904640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381377 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787381361.490183:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16750b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065904640:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787381361.549540:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787381362.200819:0:8346:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffd89374cc0 00000020:00000080:3.0:1787381362.200834:0:8346:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:3.0:1787381362.200838:0:8346:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:3.0:1787381362.200857:0:8346:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd89376f50 20000000:00000080:3.0:1787381362.200865:0:8346:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a167a5f6000 uarg=0000000000000000 20000000:01000000:3.0:1787381362.200904:0:8346:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787381362.200911:0:8346:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787381362.200927:0:8346:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787381362.210378:0:8347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1787381362.214503:0:8346:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1787381362.226821:0:8346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1787381362.226879:0:8346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1787381362.226953:0:8346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1787381362.226970:0:8346:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787381362.226990:0:8346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a1681733000/0xbdc38ada7ea0f9a8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381362.227043:0:8346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a164166a400/0xbdc38ada7ea0f71d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f716 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381362.227065:0:8346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a16413a0e00/0xbdc38ada7ea0f77f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f778 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381362.227072:0:8346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a168216ca00/0xbdc38ada7ea0f84a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f843 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381362.227082:0:8346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a164166be00/0xbdc38ada7ea0f907 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9535f3 expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381362.227090:0:8346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a1681733000/0xbdc38ada7ea0f9a8 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381362.227130:0:8346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a164166be00/0xbdc38ada7ea0f907 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9535f3 expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381362.227146:0:8346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a164166be00/0xbdc38ada7ea0f907 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9535f3 expref: 9 pid: 5784 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381362.227162:0:8346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8346:1874205065904768:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787381362.227281:0:8346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a168216ca00/0xbdc38ada7ea0f84a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbdc38ada7ea0f843 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381362.227290:0:8346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a168216ca00/0xbdc38ada7ea0f84a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f843 expref: 18 pid: 5784 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381362.227299:0:8346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8346:1874205065904896:0@lo:104: 00000100:00100000:2.0:1787381362.227337:0:8346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787381362.227372:0:8346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a16413a0e00/0xbdc38ada7ea0f77f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbdc38ada7ea0f778 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381362.227389:0:8346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a16413a0e00/0xbdc38ada7ea0f77f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f778 expref: 18 pid: 5784 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381362.227397:0:8346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8346:1874205065905024:0@lo:104: 00000100:00100000:2.0:1787381362.227421:0:8346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787381362.227443:0:8346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a164166a400/0xbdc38ada7ea0f71d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbdc38ada7ea0f716 expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381362.227449:0:8346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a164166a400/0xbdc38ada7ea0f71d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f716 expref: 18 pid: 5784 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381362.227457:0:8346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8346:1874205065905152:0@lo:104: 00000100:00100000:2.0:1787381362.227474:0:8346:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fbaccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787381362.227653:0:5773:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787381362.227672:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381362.227683:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065904896 00000100:00100000:1.0:1787381362.227690:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065904896 00000100:00100000:1.0:1787381362.227727:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065905024 00000100:00100000:1.0:1787381362.227731:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065905024 00000100:00100000:1.0:1787381362.227742:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065905152 00000100:00100000:1.0:1787381362.227745:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065905152 00000100:00100000:1.0:1787381362.227757:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787381362.227777:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+5:8346:x1874205065904896:12345-0@lo:104: 00010000:00010000:1.0:1787381362.227788:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9a164166bc00/0xbdc38ada7ea0f843 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f84a expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381362.227844:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787381362.227851:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+5:8346:x1874205065904896:12345-0@lo:104: Request processed in 77us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381362.227858:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787381362.227874:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787381362.227880:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167fb92850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+4:8346:x1874205065905024:12345-0@lo:104: 00010000:00010000:1.0:1787381362.227887:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9a168216c400/0xbdc38ada7ea0f778 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f77f expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381362.227928:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787381362.227934:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167fb92850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+4:8346:x1874205065905024:12345-0@lo:104: Request processed in 55us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381362.227940:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787381362.227969:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787381362.227975:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+3:8346:x1874205065905152:12345-0@lo:104: 00010000:00010000:1.0:1787381362.227983:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9a164166ae00/0xbdc38ada7ea0f716 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f71d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381362.228039:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787381362.228046:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+3:8346:x1874205065905152:12345-0@lo:104: Request processed in 71us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381362.228052:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1787381362.228073:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787381362.228079:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a164166bc00/0xbdc38ada7ea0f843 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f84a expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381362.228086:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a164166bc00 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:1.0:1787381362.228091:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a164166bc00/0xbdc38ada7ea0f843 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbdc38ada7ea0f84a expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381362.228099:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a164166bc00/0xbdc38ada7ea0f843 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbdc38ada7ea0f84a expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787381362.228107:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a164166bc00/0xbdc38ada7ea0f843 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbdc38ada7ea0f84a expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787381362.228112:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787381362.228137:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a164166bc00/0xbdc38ada7ea0f843 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f84a expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381362.228144:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787381362.228163:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a164166bc00/0xbdc38ada7ea0f843 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f84a expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381362.228170:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a164166bc00/0xbdc38ada7ea0f843 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f84a expref: -99 pid: 7464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381362.228192:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787381362.228195:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a168216c400/0xbdc38ada7ea0f778 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f77f expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381362.228200:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a168216c400 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:1.0:1787381362.228204:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a168216c400/0xbdc38ada7ea0f778 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbdc38ada7ea0f77f expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381362.228211:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a168216c400/0xbdc38ada7ea0f778 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbdc38ada7ea0f77f expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787381362.228217:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a168216c400/0xbdc38ada7ea0f778 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbdc38ada7ea0f77f expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787381362.228222:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787381362.228235:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a168216c400/0xbdc38ada7ea0f778 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f77f expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381362.228242:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787381362.228248:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a168216c400/0xbdc38ada7ea0f778 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f77f expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381362.228254:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a168216c400/0xbdc38ada7ea0f778 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f77f expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381362.228264:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787381362.228267:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a164166ae00/0xbdc38ada7ea0f716 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f71d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381362.228297:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a164166ae00 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:1.0:1787381362.228300:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a164166ae00/0xbdc38ada7ea0f716 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbdc38ada7ea0f71d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381362.228306:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a164166ae00/0xbdc38ada7ea0f716 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbdc38ada7ea0f71d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787381362.228312:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a164166ae00/0xbdc38ada7ea0f716 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbdc38ada7ea0f71d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787381362.228318:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787381362.228332:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a164166ae00/0xbdc38ada7ea0f716 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f71d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381362.228338:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787381362.228353:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a164166ae00/0xbdc38ada7ea0f716 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f71d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381362.228360:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a164166ae00/0xbdc38ada7ea0f716 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f71d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381362.228376:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381362.228378:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381362.228379:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381362.228387:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787381362.228406:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd19486c-5291-4823-bb9c-f3a73416a496:3310:1874205065905280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787381362.228438:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381362.228469:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787381362.228475:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd19486c-5291-4823-bb9c-f3a73416a496:3310:1874205065905408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787381362.228505:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381362.228536:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065905536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787381362.228557:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381362.228588:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065905280 00000100:00100000:1.0:1787381362.228593:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065905280 00010000:00010000:1.0:1787381362.228612:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a168216ca00/0xbdc38ada7ea0f84a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f843 expref: 19 pid: 5784 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381362.228627:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065905408 00000100:00100000:1.0:1787381362.228630:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065905408 00010000:00010000:1.0:1787381362.228640:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a16413a0e00/0xbdc38ada7ea0f77f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f778 expref: 20 pid: 5784 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381362.228650:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065905536 00000100:00100000:1.0:1787381362.228653:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065905536 00010000:00010000:1.0:1787381362.228661:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a164166a400/0xbdc38ada7ea0f71d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f716 expref: 21 pid: 5784 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381362.228673:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787381362.228679:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd19486c-5291-4823-bb9c-f3a73416a496+21:3310:x1874205065905280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787381362.228688:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381362.228693:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a168216ca00/0xbdc38ada7ea0f84a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f843 expref: 21 pid: 5784 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381362.228702:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a168216ca00/0xbdc38ada7ea0f84a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f843 expref: 21 pid: 5784 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381362.228717:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381362.228744:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd19486c-5291-4823-bb9c-f3a73416a496+21:3310:x1874205065905280:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381362.228760:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787381362.228774:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787381362.228780:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd19486c-5291-4823-bb9c-f3a73416a496+20:3310:x1874205065905408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787381362.228787:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381362.228792:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a16413a0e00/0xbdc38ada7ea0f77f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f778 expref: 20 pid: 5784 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381362.228800:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a16413a0e00/0xbdc38ada7ea0f77f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f778 expref: 20 pid: 5784 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381362.228809:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381362.228831:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd19486c-5291-4823-bb9c-f3a73416a496+20:3310:x1874205065905408:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381362.228836:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787381362.228847:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787381362.228853:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd19486c-5291-4823-bb9c-f3a73416a496+19:3308:x1874205065905536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787381362.228859:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381362.228863:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a164166a400/0xbdc38ada7ea0f71d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f716 expref: 19 pid: 5784 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381362.228872:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a164166a400/0xbdc38ada7ea0f71d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f716 expref: 19 pid: 5784 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381362.228881:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381362.228905:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd19486c-5291-4823-bb9c-f3a73416a496+19:3308:x1874205065905536:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381362.228911:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787381362.228963:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065905536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787381362.228996:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd19486c-5291-4823-bb9c-f3a73416a496:3310:1874205065905408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787381362.229029:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd19486c-5291-4823-bb9c-f3a73416a496:3310:1874205065905280:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787381362.230408:0:8346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a168216ca00/0xbdc38ada7ea0f84a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbdc38ada7ea0f843 expref: 18 pid: 5784 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381362.230427:0:8346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8346:1874205065904896:0@lo:104: 00010000:00010000:2.0:1787381362.230438:0:8346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a16413a0e00/0xbdc38ada7ea0f77f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbdc38ada7ea0f778 expref: 17 pid: 5784 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381362.230448:0:8346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8346:1874205065905024:0@lo:104: 00010000:00010000:2.0:1787381362.230456:0:8346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a164166a400/0xbdc38ada7ea0f71d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbdc38ada7ea0f716 expref: 16 pid: 5784 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381362.230466:0:8346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8346:1874205065905152:0@lo:104: 00000100:00100000:2.0:1787381362.232430:0:8346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8346:1874205065904768:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787381362.232481:0:8346:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a1681733000/0xbdc38ada7ea0f9a8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381362.233169:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381362.233261:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047002752 00000100:00100000:1.0:1787381362.233270:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047002752 00010000:00010000:1.0:1787381362.233307:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a164166be00/0xbdc38ada7ea0f907 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9535f3 expref: 10 pid: 5784 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381362.233341:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 24 00000100:00100000:1.0:1787381362.233351:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f6b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:2350:x1874205047002752:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787381362.233366:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381362.233372:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a164166be00/0xbdc38ada7ea0f907 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9535f3 expref: 10 pid: 5784 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381362.233384:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a164166be00/0xbdc38ada7ea0f907 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9535f3 expref: 10 pid: 5784 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381362.233403:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a164166be00/0xbdc38ada7ea0f907 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9535f3 expref: 10 pid: 5784 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381362.233420:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a1681733000/0xbdc38ada7ea0f9a8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381362.233429:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1681733000/0xbdc38ada7ea0f9a8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381362.233444:0:5777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a1681733000/0xbdc38ada7ea0f9a8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381362.233452:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a1681733000/0xbdc38ada7ea0f9a8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381362.233466:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a1681733000/0xbdc38ada7ea0f9a8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381362.233473:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a1681733000/0xbdc38ada7ea0f9a8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381362.233479:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681733000 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:1.0:1787381362.233483:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a1681733000/0xbdc38ada7ea0f9a8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381362.233490:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a1681733000/0xbdc38ada7ea0f9a8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381362.233512:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a1681733000/0xbdc38ada7ea0f9a8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381362.233522:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381362.233578:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f6b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c93c8548-229c-4d2f-8357-13904b6fe0fb+9:2350:x1874205047002752:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 228us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381362.233585:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 24 00010000:00010000:3.0:1787381362.233710:0:8346:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a1681733000/0xbdc38ada7ea0f9a8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381362.233717:0:8346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a1681733000/0xbdc38ada7ea0f9a8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381362.233723:0:8346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1681733000/0xbdc38ada7ea0f9a8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381362.572590:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381363.596374:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787381363.864299:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381363.864335:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381363.864376:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381363.864400:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047003008 00000100:00100000:0.0:1787381363.864409:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047003008 00000100:00100000:0.0:1787381363.864467:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 31 00000100:00100000:0.0:1787381363.864477:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16750b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+6:2352:x1874205047003008:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787381363.864552:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16750b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+6:2352:x1874205047003008:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 76us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381363.864560:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 31 00000100:00100000:0.0:1787381363.864607:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381363.864707:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047003136 00000100:00100000:0.0:1787381363.864712:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047003136 00000100:00100000:0.0:1787381363.864734:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047003264 00000100:00100000:0.0:1787381363.864737:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047003264 00000100:00100000:0.0:1787381363.864754:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:0.0:1787381363.864760:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16750b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+5:2352:x1874205047003136:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787381363.864789:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16750b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+5:2352:x1874205047003136:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 29us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381363.864795:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:0.0:1787381363.864806:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:0.0:1787381363.864812:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16750b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+5:2352:x1874205047003264:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787381363.864834:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16750b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+5:2352:x1874205047003264:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 23us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381363.864852:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00080000:1.0:1787381363.867976:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787381363.867987:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787381363.867992:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787381363.873248:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047002880 00000100:00100000:2.0:1787381363.873326:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047002880 00000100:00100000:2.0:1787381363.873461:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 172 00000100:00100000:2.0:1787381363.873472:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+9:2352:x1874205047002880:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787381363.873615:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+9:2352:x1874205047002880:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 145us (9324us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381363.873623:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 172 00000100:00100000:1.0:1787381363.911937:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381363.912029:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047003392 00000100:00100000:3.0:1787381363.912039:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047003392 00000100:00100000:3.0:1787381363.912106:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 173 00000100:00100000:3.0:1787381363.912124:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+9:5567:x1874205047003392:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787381363.912142:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381363.912162:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1647eb0200/0xbdc38ada7ea0f9af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc01952459a953632 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381363.912190:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1647eb0200/0xbdc38ada7ea0f9af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953632 expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381363.912202:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1647eb0200/0xbdc38ada7ea0f9af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953632 expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381363.912211:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb0200, rc 0) 00000100:00100000:3.0:1787381363.912263:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:5567:x1874205047003392:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 Request processed in 141us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381363.912270:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 173 00000100:00100000:2.0:1787381363.923070:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381363.923512:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047003520 00000100:00100000:1.0:1787381363.923523:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047003520 00000100:00100000:1.0:1787381363.923580:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 174 00000100:00100000:1.0:1787381363.923591:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:5567:x1874205047003520:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787381363.923882:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:5567:x1874205047003520:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 Request processed in 292us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381363.923890:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 174 00000100:00100000:1.0:1787381363.935313:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381363.935348:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047003648 00000100:00100000:1.0:1787381363.935358:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047003648 00000100:00100000:1.0:1787381363.935419:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 175 00000100:00100000:1.0:1787381363.935429:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:5567:x1874205047003648:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787381363.936222:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:5567:x1874205047003648:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 Request processed in 791us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381363.936233:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 175 00000100:00100000:2.0:1787381363.947872:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381363.948066:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047003776 00000100:00100000:2.0:1787381363.948075:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047003776 00000100:00100000:2.0:1787381363.948119:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 176 00000100:00100000:2.0:1787381363.948127:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:6103:x1874205047003776:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787381363.948372:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:6103:x1874205047003776:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 244us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381363.948381:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 176 00000100:00100000:0.0:1787381363.965141:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381363.965194:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047003904 00000100:00100000:0.0:1787381363.965205:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047003904 00000100:00100000:0.0:1787381363.965259:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 177 00000100:00100000:0.0:1787381363.965269:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1650553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:6103:x1874205047003904:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787381363.965512:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1650553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:6103:x1874205047003904:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 244us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381363.965520:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 177 10000000:01000000:1.0:1787381363.980116:0:5787:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787381363.980123:0:5787:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a16436a3000 from 4 10000000:01000000:1.0:1787381363.980128:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787381363.980178:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea0f9b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381363.980192:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea0f9b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381363.980203:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea0f9b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381363.980229:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065905664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787381363.980300:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381363.980348:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f94a300 going to sleep for 11 seconds 00000100:00100000:2.0:1787381363.980628:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065905664 00000100:00100000:2.0:1787381363.980637:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065905664 00000100:00100000:2.0:1787381363.980684:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787381363.980693:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1650552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+16:5787:x1874205065905664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787381363.980706:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381363.980721:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1681732000/0xbdc38ada7ea0f9bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0f9b6 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381363.980743:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1681732000/0xbdc38ada7ea0f9bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f9b6 expref: 17 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381363.980764:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1681732000/0xbdc38ada7ea0f9bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f9b6 expref: 17 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381363.980772:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1681732000, rc 0) 00000100:00100000:2.0:1787381363.982772:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1650552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+17:5787:x1874205065905664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2073us (2466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381363.982784:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787381363.984795:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065905664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787381363.984826:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea0f9b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f9bd expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381363.984838:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea0f9b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f9bd expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381363.984934:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065905792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787381363.984987:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381363.985724:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16430ad480 going to sleep for 11 seconds 00000100:00100000:2.0:1787381363.988741:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065905792 00000100:00100000:2.0:1787381363.988754:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065905792 00000100:00100000:2.0:1787381363.988825:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787381363.988837:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+17:5787:x1874205065905792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787381363.989172:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+17:5787:x1874205065905792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 336us (4182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381363.989181:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787381363.989245:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065905792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787381363.989301:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065905920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787381363.989348:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381363.989383:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fbac600 going to sleep for 11 seconds 00000100:00100000:3.0:1787381363.989530:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065905920 00000100:00100000:3.0:1787381363.989535:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065905920 00000100:00100000:3.0:1787381363.989765:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1787381363.989774:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+17:5787:x1874205065905920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787381363.989940:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+17:5787:x1874205065905920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381363.989947:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787381363.990046:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065905920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787381363.993691:0:8409:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:8409:1874205065906048:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787381363.993772:0:8409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381363.993878:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065906048 00000100:00100000:2.0:1787381363.993885:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065906048 00000100:00100000:2.0:1787381363.993940:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787381363.993955:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+17:8409:x1874205065906048:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787381363.995088:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+17:8409:x1874205065906048:12345-0@lo:502:llog_process_th.0 Request processed in 1128us (1310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381363.995099:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787381363.995172:0:8409:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fbacc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787381363.995198:0:8409:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:8409:1874205065906048:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787381363.995231:0:8409:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787381363.995240:0:8409:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787381363.995243:0:8409:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787381363.995249:0:8409:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a16436a3000 00000020:00000080:2.0:1787381363.995253:0:8409:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787381364.000622:0:8409:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:8409:1874205065906176:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787381364.000705:0:8409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381364.000740:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065906176 00000100:00100000:2.0:1787381364.000747:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065906176 00000100:00100000:2.0:1787381364.000795:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787381364.000804:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+17:8409:x1874205065906176:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787381364.004977:0:8409:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fbacc00 going to sleep for 10 seconds 00000100:00100000:2.0:1787381364.006432:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+17:8409:x1874205065906176:12345-0@lo:502:llog_process_th.0 Request processed in 5620us (5718us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381364.006445:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787381364.012788:0:8409:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:8409:1874205065906176:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787381364.013966:0:8409:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787381364.013980:0:8409:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787381364.013983:0:8409:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787381364.013988:0:8409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787381364.014227:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787381364.014253:0:5787:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787381364.014265:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea0f9b6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f9bd expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381364.014276:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea0f9b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f9bd expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787381364.014286:0:5787:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787381364.014289:0:5787:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a1646496800 from 4 10000000:01000000:3.0:1787381364.014291:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787381364.014326:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1a00/0xbdc38ada7ea0f9c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381364.014334:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1a00/0xbdc38ada7ea0f9c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381364.014344:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1a00/0xbdc38ada7ea0f9c4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381364.014369:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065906304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787381364.014439:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381364.014507:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16430ada80 going to sleep for 11 seconds 00000100:00100000:2.0:1787381364.014734:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065906304 00000100:00100000:2.0:1787381364.014742:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065906304 00000100:00100000:2.0:1787381364.014802:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787381364.014811:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+17:5787:x1874205065906304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787381364.014833:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381364.014847:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1681733c00/0xbdc38ada7ea0f9cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0f9c4 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381364.014873:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1681733c00/0xbdc38ada7ea0f9cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f9c4 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381364.014884:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1681733c00/0xbdc38ada7ea0f9cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f9c4 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381364.014894:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1681733c00, rc 0) 00000100:00100000:2.0:1787381364.014954:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+18:5787:x1874205065906304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381364.014962:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787381364.015029:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065906304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787381364.015042:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1a00/0xbdc38ada7ea0f9c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f9cb expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381364.015052:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1a00/0xbdc38ada7ea0f9c4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f9cb expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381364.015104:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065906432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787381364.015133:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381364.015147:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fbacb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787381364.015160:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065906432 00000100:00100000:2.0:1787381364.015164:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065906432 00000100:00100000:2.0:1787381364.015191:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787381364.015198:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+18:5787:x1874205065906432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787381364.015451:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+18:5787:x1874205065906432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 253us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381364.015459:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787381364.015494:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065906432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787381364.015523:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065906560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787381364.015561:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381364.015575:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fbacb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787381364.015586:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065906560 00000100:00100000:2.0:1787381364.015589:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065906560 00000100:00100000:2.0:1787381364.015606:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787381364.015612:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+18:5787:x1874205065906560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787381364.017075:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+18:5787:x1874205065906560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1456us (1507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381364.017086:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787381364.017143:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065906560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787381364.020955:0:8414:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16750b5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:8414:1874205065906688:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787381364.021176:0:8414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381364.021437:0:8414:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a166fbd63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787381364.023328:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065906688 00000100:00100000:2.0:1787381364.023342:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065906688 00000100:00100000:2.0:1787381364.023400:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787381364.023410:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+18:8414:x1874205065906688:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787381364.037685:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+18:8414:x1874205065906688:12345-0@lo:502:llog_process_th.0 Request processed in 14270us (16504us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381364.037700:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787381364.039136:0:8414:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16750b5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:8414:1874205065906688:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787381364.039186:0:8414:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787381364.039197:0:8414:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787381364.039199:0:8414:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787381364.040304:0:8414:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a1646496800 00000020:00000080:1.0:1787381364.040308:0:8414:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787381364.040416:0:8414:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:8414:1874205065906816:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787381364.040487:0:8414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381364.040523:0:8414:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f94a240 going to sleep for 11 seconds 00000100:00100000:3.0:1787381364.043148:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065906816 00000100:00100000:3.0:1787381364.043164:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065906816 00000100:00100000:3.0:1787381364.043287:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787381364.043299:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+18:8414:x1874205065906816:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787381364.043560:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+18:8414:x1874205065906816:12345-0@lo:502:llog_process_th.0 Request processed in 262us (3071us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381364.043568:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787381364.043782:0:8414:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:8414:1874205065906816:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787381364.043817:0:8414:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787381364.043825:0:8414:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787381364.043827:0:8414:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787381364.043832:0:8414:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787381364.045335:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787381364.045361:0:5787:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787381364.045373:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1a00/0xbdc38ada7ea0f9c4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f9cb expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381364.045386:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1a00/0xbdc38ada7ea0f9c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f9cb expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787381364.045396:0:5787:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787381364.045399:0:5787:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a16659a7000 from 4 10000000:01000000:3.0:1787381364.045402:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787381364.045434:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1c00/0xbdc38ada7ea0f9d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381364.045442:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1c00/0xbdc38ada7ea0f9d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381364.045452:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1c00/0xbdc38ada7ea0f9d2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381364.045475:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6bb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065906944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787381364.045529:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381364.045571:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16430ada80 going to sleep for 11 seconds 00000100:00100000:3.0:1787381364.045619:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065906944 00000100:00100000:3.0:1787381364.045625:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065906944 00000100:00100000:3.0:1787381364.045659:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787381364.045667:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+18:5787:x1874205065906944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787381364.045679:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381364.045692:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1647eb0000/0xbdc38ada7ea0f9d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0f9d2 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381364.045714:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1647eb0000/0xbdc38ada7ea0f9d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f9d2 expref: 19 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381364.045724:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1647eb0000/0xbdc38ada7ea0f9d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f9d2 expref: 19 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381364.045732:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb0000, rc 0) 00000100:00100000:3.0:1787381364.046394:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+19:5787:x1874205065906944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 724us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381364.046402:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787381364.059266:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6bb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065906944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787381364.059294:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1c00/0xbdc38ada7ea0f9d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f9d9 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381364.059307:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1c00/0xbdc38ada7ea0f9d2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f9d9 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381364.059377:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6bb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065907072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787381364.059432:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381364.059470:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16430ada80 going to sleep for 11 seconds 00000100:00100000:3.0:1787381364.059486:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065907072 00000100:00100000:3.0:1787381364.059491:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065907072 00000100:00100000:3.0:1787381364.059525:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787381364.059532:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+19:5787:x1874205065907072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787381364.059742:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+19:5787:x1874205065907072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 209us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381364.059749:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787381364.064918:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6bb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065907072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787381364.064984:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065907200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787381364.065084:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381364.065124:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1645a34300 going to sleep for 11 seconds 00000100:00100000:2.0:1787381364.065149:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065907200 00000100:00100000:2.0:1787381364.065155:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065907200 00000100:00100000:2.0:1787381364.065195:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787381364.065203:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+19:5787:x1874205065907200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787381364.065390:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+19:5787:x1874205065907200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 187us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381364.065398:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1787381364.065446:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065907200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787381364.068920:0:8418:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6bb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:8418:1874205065907328:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787381364.068995:0:8418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381364.069052:0:8418:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16430ad180 going to sleep for 11 seconds 00000100:00100000:2.0:1787381364.069179:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065907328 00000100:00100000:2.0:1787381364.069186:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065907328 00000100:00100000:2.0:1787381364.069231:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787381364.069240:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+19:8418:x1874205065907328:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787381364.069476:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+19:8418:x1874205065907328:12345-0@lo:502:llog_process_th.0 Request processed in 236us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381364.069484:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1787381364.074683:0:8418:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6bb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:8418:1874205065907328:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787381364.074726:0:8418:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787381364.074738:0:8418:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787381364.074741:0:8418:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787381364.074749:0:8418:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a16659a7000 00000020:00000080:3.0:1787381364.074751:0:8418:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787381364.074847:0:8418:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6bb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:8418:1874205065907456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787381364.074924:0:8418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381364.074970:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065907456 00000100:00100000:3.0:1787381364.074976:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065907456 00000100:00100000:3.0:1787381364.075033:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787381364.075042:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16461b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+19:8418:x1874205065907456:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787381364.075253:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16461b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+19:8418:x1874205065907456:12345-0@lo:502:llog_process_th.0 Request processed in 212us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381364.075261:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787381364.075310:0:8418:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16430ad180 going to sleep for 11 seconds 00000100:00100000:3.0:1787381364.075325:0:8418:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6bb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:8418:1874205065907456:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787381364.075340:0:8418:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787381364.075344:0:8418:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787381364.075346:0:8418:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787381364.075350:0:8418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787381364.078071:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787381364.078143:0:5787:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787381364.078167:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1c00/0xbdc38ada7ea0f9d2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f9d9 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381364.078188:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1c00/0xbdc38ada7ea0f9d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f9d9 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381364.628676:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381365.644582:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787381366.092261:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd19486c-5291-4823-bb9c-f3a73416a496:3309:1874205065907584:0@lo:400:kworker.0 00000100:00100000:0.0:1787381366.092338:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381366.092473:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065907584 00000100:00100000:2.0:1787381366.092481:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065907584 00000100:00100000:2.0:1787381366.092524:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1787381366.092533:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+19:3309:x1874205065907584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381366.095061:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+19:3309:x1874205065907584:12345-0@lo:400:kworker.0 Request processed in 2521us (2714us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381366.095075:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1787381366.101071:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065907968:0@lo:400:kworker.0 00000100:00100000:3.0:1787381366.101102:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874205065907712:0@lo:400:kworker.0 00000100:00100000:3.0:1787381366.101137:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381366.101137:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381366.101231:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd19486c-5291-4823-bb9c-f3a73416a496:3309:1874205065907584:0@lo:400:kworker.0 00000100:00100000:0.0:1787381366.101275:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065907968 00000100:00100000:0.0:1787381366.101282:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065907968 00000100:00100000:0.0:1787381366.101344:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787381366.101354:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065907968:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787381366.101419:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787381366.103269:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1874205065908096:0@lo:400:kworker.0 00000100:00100000:1.0:1787381366.103320:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381366.103404:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1874205065907840:0@lo:400:kworker.0 00000100:00100000:1.0:1787381366.103429:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381366.103446:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065908352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787381366.103468:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381366.103504:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065908352 00000100:00100000:1.0:1787381366.103510:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065908352 00000100:00100000:1.0:1787381366.103548:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787381366.103566:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874205065908352:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787381366.103597:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065908224:0@lo:400:kworker.0 00002000:00000024:1.0:1787381366.103600:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787381366.103625:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381366.103650:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874205065908352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381366.103657:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065907712 00000100:00100000:1.0:1787381366.103658:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787381366.103661:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065907712 00000100:00100000:1.0:1787381366.103678:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065908096 00000100:00100000:3.0:1787381366.103680:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065907840 00000100:00100000:1.0:1787381366.103681:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065908096 00000100:00100000:3.0:1787381366.103682:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065907840 00000100:00100000:3.0:1787381366.103770:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787381366.103777:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f6b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874205065907712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381366.103799:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787381366.103812:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1787381366.103815:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f6b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874205065907712:12345-0@lo:400:kworker.0 Request processed in 40us (2678us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381366.103821:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787381366.103841:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787381366.103847:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874205065907840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787381366.103874:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874205065907840:12345-0@lo:400:kworker.0 Request processed in 28us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381366.103879:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787381366.103905:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065908224 00000100:00100000:3.0:1787381366.103909:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065908224 00000100:00100000:0.0:1787381366.103987:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065907968:12345-0@lo:400:kworker.0 Request processed in 2634us (2849us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381366.103995:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1787381366.104067:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167f6bb100 x1874205065907968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787381382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381366.104092:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065907968:0@lo:400:kworker.0 00000100:00100000:0.0:1787381366.104134:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1874205065907840:0@lo:400:kworker.0 00010000:00080000:0.0:1787381366.104143:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167f59f480 x1874205065908352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381382 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381366.104155:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065908352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787381366.104409:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787381366.104417:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874205065908096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381366.104456:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874205065908096:12345-0@lo:400:kworker.0 Request processed in 41us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381366.104462:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787381366.104489:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1874205065908096:0@lo:400:kworker.0 00000100:00080000:2.0:1787381366.107172:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787381366.107184:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787381366.110902:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787381366.110919:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f6b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065908224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787381366.111020:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f6b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065908224:12345-0@lo:400:kworker.0 Request processed in 89us (7376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381366.111029:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787381366.111083:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874205065907712:0@lo:400:kworker.0 00010000:00080000:3.0:1787381366.111098:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167f6bb480 x1874205065908224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787381382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787381366.111109:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065908224:0@lo:400:kworker.0 00000100:00100000:2.0:1787381366.609856:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065908480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787381366.609939:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381366.613269:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065908480 00000100:00100000:2.0:1787381366.613283:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065908480 00000100:00100000:2.0:1787381366.613335:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787381366.613344:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065908480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787381366.613380:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787381366.613455:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065908480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (3516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381366.613463:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1787381366.613521:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a6f7100 x1874205065908480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381382 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787381366.613539:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065908480:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787381366.675535:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381367.696732:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381368.717490:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787381368.979179:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381368.979214:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381368.979243:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381368.979283:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381368.979313:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047004160 00000100:00100000:2.0:1787381368.979322:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047004160 00000100:00100000:2.0:1787381368.979383:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 35 00000100:00100000:2.0:1787381368.979393:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+6:2352:x1874205047004160:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787381368.979461:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+6:2352:x1874205047004160:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 70us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381368.979481:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 35 00000100:00080000:2.0:1787381368.979504:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787381368.979627:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047004032 00000100:00100000:3.0:1787381368.979632:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047004032 00000100:00100000:3.0:1787381368.979663:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 194 00000100:00100000:3.0:1787381368.979670:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:2352:x1874205047004032:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381368.979697:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:2352:x1874205047004032:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 28us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381368.979716:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 194 00000100:00100000:0.0:1787381368.980460:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047004288 00000100:00100000:0.0:1787381368.980466:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047004288 00000100:00100000:0.0:1787381368.980506:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047004416 00000100:00100000:0.0:1787381368.980509:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047004416 00000100:00100000:0.0:1787381368.980532:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:0.0:1787381368.980540:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2157c09-10df-40cb-8228-ad4822122c97+5:2352:x1874205047004288:12345-192.168.203.22@tcp:400:kworker.0 00000100:00080000:2.0:1787381368.980611:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787381368.980615:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787381368.980657:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:3.0:1787381368.980676:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2157c09-10df-40cb-8228-ad4822122c97+5:2352:x1874205047004416:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381368.980781:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2157c09-10df-40cb-8228-ad4822122c97+5:2352:x1874205047004416:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 106us (1496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381368.980788:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:0.0:1787381368.987882:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2157c09-10df-40cb-8228-ad4822122c97+5:2352:x1874205047004288:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 7318us (8642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381368.987897:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 19 00000001:02000400:2.0:1787381369.273986:0:8648:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1787381369.740205:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381370.764101:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787381371.213271:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16750b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1874205065908864:0@lo:400:kworker.0 00000100:00100000:2.0:1787381371.213438:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16750b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd19486c-5291-4823-bb9c-f3a73416a496:3309:1874205065908608:0@lo:400:kworker.0 00000100:00100000:2.0:1787381371.213477:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381371.213526:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16750b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1874205065909120:0@lo:400:kworker.0 00000100:00100000:2.0:1787381371.213557:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065908608 00000100:00100000:2.0:1787381371.213564:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065908608 00000100:00100000:2.0:1787381371.213606:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787381371.213614:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+19:3309:x1874205065908608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381371.213659:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+19:3309:x1874205065908608:12345-0@lo:400:kworker.0 Request processed in 46us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381371.213667:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1787381371.213805:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16750b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065908992:0@lo:400:kworker.0 00000100:00100000:3.0:1787381371.213837:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381371.213889:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16750b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874205065908736:0@lo:400:kworker.0 00000100:00100000:2.0:1787381371.213956:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065908992 00000100:00100000:2.0:1787381371.213961:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065908992 00000100:00100000:2.0:1787381371.214017:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787381371.214025:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f6bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065908992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381371.214072:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f6bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065908992:12345-0@lo:400:kworker.0 Request processed in 48us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381371.214078:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1787381371.214231:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787381371.214259:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a16750b4700 x1874205065908992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787381387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787381371.214271:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16750b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065908992:0@lo:400:kworker.0 00000100:00100000:0.0:1787381371.214326:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381371.214449:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065909376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787381371.214474:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381371.214545:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381371.214580:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16750b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd19486c-5291-4823-bb9c-f3a73416a496:3309:1874205065908608:0@lo:400:kworker.0 00000100:00100000:0.0:1787381371.214635:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065908864 00000100:00100000:0.0:1787381371.214640:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065908864 00000100:00100000:1.0:1787381371.214668:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381371.214688:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16750b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065909248:0@lo:400:kworker.0 00000100:00100000:1.0:1787381371.214713:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381371.214724:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065909120 00000100:00100000:0.0:1787381371.214727:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065909120 00000100:00100000:1.0:1787381371.214751:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065908736 00000100:00100000:1.0:1787381371.214754:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065908736 00000100:00100000:2.0:1787381371.214772:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787381371.214779:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787381371.214780:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16750b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874205065908864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381371.214784:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874205065908736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381371.214821:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874205065908736:12345-0@lo:400:kworker.0 Request processed in 36us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381371.214823:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16750b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874205065908864:12345-0@lo:400:kworker.0 Request processed in 45us (1481us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381371.214827:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787381371.214830:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787381371.214844:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065909376 00000100:00100000:2.0:1787381371.214846:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065909376 00000100:00100000:1.0:1787381371.214864:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16750b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874205065908736:0@lo:400:kworker.0 00000100:00100000:2.0:1787381371.214881:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787381371.214887:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16750b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065909376:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787381371.214887:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065909248 00000100:00100000:1.0:1787381371.214890:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065909248 00002000:00000024:2.0:1787381371.214917:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787381371.214947:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16750b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065909376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381371.214953:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1787381371.219910:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787381371.219921:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787381371.221958:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787381371.221989:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f6b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874205065909120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381371.222105:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f6b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874205065909120:12345-0@lo:400:kworker.0 Request processed in 121us (7559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381371.222113:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787381371.222169:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16750b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1874205065909120:0@lo:400:kworker.0 00010000:00080000:0.0:1787381371.222209:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167f59f480 x1874205065909376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381387 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381371.222226:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065909376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787381371.222240:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16750b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1874205065908864:0@lo:400:kworker.0 00000100:00100000:1.0:1787381371.224708:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787381371.224725:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065909248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381371.224837:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065909248:12345-0@lo:400:kworker.0 Request processed in 119us (10123us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381371.224844:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1787381371.224961:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a16750b7800 x1874205065909248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787381387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787381371.224976:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16750b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065909248:0@lo:400:kworker.0 00000100:00100000:2.0:1787381371.725526:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787381371.725548:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065909504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787381371.725613:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381371.725672:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065909504 00000100:00100000:2.0:1787381371.725679:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065909504 00000100:00100000:2.0:1787381371.725719:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787381371.725728:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065909504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787381371.725764:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787381371.725807:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065909504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381371.725813:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1787381371.725865:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a6f4700 x1874205065909504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381387 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787381371.725892:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065909504:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787381371.796810:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381372.812639:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381373.838931:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787381374.104730:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381374.104769:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381374.104802:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047004672 00000100:00100000:0.0:1787381374.104811:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047004672 00000100:00100000:0.0:1787381374.104877:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00100000:0.0:1787381374.104887:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16750b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+6:2349:x1874205047004672:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787381374.104967:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16750b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+6:2349:x1874205047004672:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 81us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381374.104974:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00080000:0.0:1787381374.104995:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787381374.105375:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047004544 00000100:00100000:1.0:1787381374.105380:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047004544 00000100:00100000:1.0:1787381374.105419:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 196 00000100:00100000:1.0:1787381374.105427:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:2349:x1874205047004544:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787381374.105462:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:2349:x1874205047004544:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 36us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381374.105469:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 196 00000100:00100000:0.0:1787381374.110874:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381374.111260:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047004800 00000100:00100000:2.0:1787381374.111269:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047004800 00000100:00100000:2.0:1787381374.111378:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:2.0:1787381374.111388:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16750b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2157c09-10df-40cb-8228-ad4822122c97+5:2348:x1874205047004800:12345-192.168.203.22@tcp:9:kworker.0 00000020:00000080:2.0:1787381374.111423:0:6590:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbdc38ada7ea0f915 00000100:00080000:2.0:1787381374.111433:0:6590:0:(import.c:65:import_set_state_nolock()) ffff9a1675066800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787381374.111467:0:6590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787381374.112275:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16750b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2157c09-10df-40cb-8228-ad4822122c97+2:2348:x1874205047004800:12345-192.168.203.22@tcp:9:kworker.0 Request processed in 886us (1408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381374.112284:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 10 00010000:00010000:2.0:1787381374.112338:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787381374.112805:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787381374.112985:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381374.113104:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047004928 00000100:00100000:3.0:1787381374.113111:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047004928 00000100:00100000:3.0:1787381374.113199:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:3.0:1787381374.113209:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2157c09-10df-40cb-8228-ad4822122c97+5:2348:x1874205047004928:12345-192.168.203.22@tcp:9:kworker.0 00000020:00000080:3.0:1787381374.113240:0:6587:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbdc38ada7ea0f91c 00000100:00080000:3.0:1787381374.113257:0:6587:0:(import.c:65:import_set_state_nolock()) ffff9a1675060800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787381374.113289:0:6587:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:2.0:1787381374.113549:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787381374.114558:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2157c09-10df-40cb-8228-ad4822122c97+2:2348:x1874205047004928:12345-192.168.203.22@tcp:9:kworker.0 Request processed in 1345us (1568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381374.114570:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 11 00010000:00010000:3.0:1787381374.114624:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787381374.373281:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f2157c09-10df-40cb-8228-ad4822122c97 00000020:00000080:1.0:1787381374.373290:0:6614:0:(genops.c:906:class_export_put()) final put ffff9a1675063800/f2157c09-10df-40cb-8228-ad4822122c97 00000020:00000080:3.0:1787381374.373374:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9a1675063800/f2157c09-10df-40cb-8228-ad4822122c97 for lustre-OST0000 00000020:00000080:3.0:1787381374.373418:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a1675066800 for lustre-OST0000 00010000:00010000:0.0:1787381374.866271:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787381374.957422:0:8893:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing yml_node 00010000:00010000:2.0:1787381375.887614:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787381376.333279:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787381376.333302:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065909632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787381376.333370:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381376.333429:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065909632 00000100:00100000:1.0:1787381376.333437:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065909632 00000100:00100000:1.0:1787381376.333489:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787381376.333597:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065909632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787381376.333632:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787381376.333683:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065909632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 186us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381376.333691:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1787381376.333712:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787381376.333769:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167f59c380 x1874205065909632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381376.333788:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065909632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787381376.334323:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787381376.334739:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787381376.334760:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874205065909888:0@lo:400:kworker.0 00000100:00100000:1.0:1787381376.334805:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381376.334900:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065909888 00000100:00100000:2.0:1787381376.334907:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065909888 00000100:00100000:2.0:1787381376.334956:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787381376.334965:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874205065909888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381376.335051:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874205065909888:12345-0@lo:400:kworker.0 Request processed in 87us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381376.335058:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787381376.335212:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874205065909888:0@lo:400:kworker.0 00000100:00100000:0.0:1787381376.335657:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd19486c-5291-4823-bb9c-f3a73416a496:3311:1874205065909760:0@lo:400:kworker.0 00000100:00100000:0.0:1787381376.335702:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381376.336047:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065909760 00000100:00100000:2.0:1787381376.336053:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065909760 00000100:00100000:2.0:1787381376.336097:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1787381376.336115:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+19:3311:x1874205065909760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381376.336163:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+19:3311:x1874205065909760:12345-0@lo:400:kworker.0 Request processed in 49us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381376.336169:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1787381376.337175:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd19486c-5291-4823-bb9c-f3a73416a496:3311:1874205065909760:0@lo:400:kworker.0 00000100:00100000:2.0:1787381376.350203:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1874205065910016:0@lo:400:kworker.0 00000100:00100000:2.0:1787381376.350267:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381376.350336:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065910016 00000100:00100000:2.0:1787381376.350343:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065910016 00000100:00100000:2.0:1787381376.350420:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787381376.350430:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874205065910016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381376.350481:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a806680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874205065910016:12345-0@lo:400:kworker.0 Request processed in 53us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381376.350489:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787381376.350532:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1874205065910016:0@lo:400:kworker.0 00000100:00100000:2.0:1787381376.350567:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1874205065910144:0@lo:400:kworker.0 00000100:00100000:2.0:1787381376.350590:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381376.350617:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065910144 00000100:00100000:2.0:1787381376.350620:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065910144 00000100:00100000:2.0:1787381376.350644:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787381376.350649:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874205065910144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381376.350683:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a805500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874205065910144:12345-0@lo:400:kworker.0 Request processed in 34us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381376.350689:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787381376.350713:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1874205065910144:0@lo:400:kworker.0 00000100:00100000:2.0:1787381376.350750:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065910272:0@lo:400:kworker.0 00000100:00100000:2.0:1787381376.350786:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787381376.354142:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787381376.354210:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065910272 00000100:00100000:1.0:1787381376.354221:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065910272 00000100:00100000:1.0:1787381376.354307:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787381376.354318:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065910272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381376.354755:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065910272:12345-0@lo:400:kworker.0 Request processed in 438us (3967us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381376.354764:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1787381376.354847:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a804380 x1874205065910272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787381392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381376.354862:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065910272:0@lo:400:kworker.0 00000100:00080000:3.0:1787381376.355126:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787381376.844476:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a806300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065910400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787381376.844546:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381376.844719:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065910400 00000100:00100000:2.0:1787381376.844727:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065910400 00000100:00100000:2.0:1787381376.844780:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787381376.844790:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065910400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787381376.844836:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787381376.844884:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065910400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381376.844891:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1787381376.844930:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a806300 x1874205065910400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787381376.844946:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a806300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065910400:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787381376.908858:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381377.932156:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787381378.438840:0:7481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f2157c09-10df-40cb-8228-ad4822122c97 00000020:00000080:1.0:1787381378.438850:0:7481:0:(genops.c:906:class_export_put()) final put ffff9a1675062000/f2157c09-10df-40cb-8228-ad4822122c97 00000020:00000080:2.0:1787381378.440800:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a1675062000/f2157c09-10df-40cb-8228-ad4822122c97 for lustre-OST0001 00000020:00000080:3.0:1787381378.440945:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a1675060800 for lustre-OST0001 00010000:00010000:0.0:1787381378.957585:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787381379.218605:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381379.218652:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381379.218685:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047005184 00000100:00100000:0.0:1787381379.218694:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047005184 00000100:00100000:0.0:1787381379.218763:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 43 00000100:00100000:0.0:1787381379.218773:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16750b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+6:2352:x1874205047005184:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381379.218851:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047005056 00000100:00100000:3.0:1787381379.218856:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047005056 00000100:00100000:3.0:1787381379.218899:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 198 00000100:00100000:3.0:1787381379.218906:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:2352:x1874205047005056:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381379.218972:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:2352:x1874205047005056:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 54us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381379.218980:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 198 00000100:00080000:3.0:1787381379.219025:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787381379.219358:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16750b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+6:2352:x1874205047005184:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 584us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381379.219366:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 43 00000001:02000400:2.0:1787381379.887358:0:9086:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.115 00010000:00010000:2.0:1787381379.983257:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381381.006321:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787381381.456506:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16750b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1874205065910784:0@lo:400:kworker.0 00000100:00100000:0.0:1787381381.456576:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381381.456650:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787381381.456657:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16750b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065910912:0@lo:400:kworker.0 00000100:00100000:0.0:1787381381.456683:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381381.456867:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065910912 00000100:00100000:1.0:1787381381.456875:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065910912 00000100:00100000:1.0:1787381381.456959:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787381381.456970:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16750b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065910912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381381.457046:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16750b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065910912:12345-0@lo:400:kworker.0 Request processed in 78us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381381.457054:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1787381381.457098:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a16750b6a00 x1874205065910912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787381397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381381.457124:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16750b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065910912:0@lo:400:kworker.0 00000100:00080000:0.0:1787381381.457500:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787381381.459385:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16750b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065910528:0@lo:400:kworker.0 00000100:00100000:2.0:1787381381.459454:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381381.459503:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16750b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1874205065911040:0@lo:400:kworker.0 00000100:00100000:2.0:1787381381.459529:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381381.459563:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787381381.459570:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16750b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874205065910656:0@lo:400:kworker.0 00000100:00100000:1.0:1787381381.459598:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a806300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065911296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787381381.459613:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381381.459627:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381381.459632:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16750b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065911168:0@lo:400:kworker.0 00000100:00100000:2.0:1787381381.459653:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381381.459677:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065910784 00000100:00100000:1.0:1787381381.459683:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065910784 00000100:00100000:2.0:1787381381.459684:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065911040 00000100:00100000:2.0:1787381381.459687:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065911040 00000100:00100000:2.0:1787381381.459730:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065910656 00000100:00100000:2.0:1787381381.459733:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065910656 00000100:00100000:3.0:1787381381.459734:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065910528 00000100:00100000:3.0:1787381381.459737:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065910528 00000100:00100000:2.0:1787381381.459748:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787381381.459756:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874205065911040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787381381.459759:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787381381.459764:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+19:3308:x1874205065910528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381381.459821:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a805880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874205065911040:12345-0@lo:400:kworker.0 Request processed in 65us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381381.459828:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787381381.459844:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787381381.459850:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874205065910656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381381.463172:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065911168 00000100:00100000:0.0:1787381381.463185:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065911168 00000100:00100000:0.0:1787381381.463233:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787381381.463256:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065911168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787381381.463412:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+19:3308:x1874205065910528:12345-0@lo:400:kworker.0 Request processed in 3645us (3956us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381381.463422:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:3.0:1787381381.463477:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787381381.463481:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787381381.463553:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a805f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874205065910656:12345-0@lo:400:kworker.0 Request processed in 3701us (3937us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381381.463561:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787381381.463620:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065911296 00000100:00100000:2.0:1787381381.463624:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065911296 00000100:00100000:2.0:1787381381.463650:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787381381.463657:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065911296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787381381.463684:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787381381.463722:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065911296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (4094us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381381.463729:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787381381.470176:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787381381.470199:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16750b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874205065910784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381381.470296:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16750b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874205065910784:12345-0@lo:400:kworker.0 Request processed in 109us (13721us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381381.470455:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1787381381.470516:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a806300 x1874205065911296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381397 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381381.470536:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a806300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065911296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787381381.470551:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16750b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1874205065910784:0@lo:400:kworker.0 00000100:00100000:3.0:1787381381.470674:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16750b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874205065910656:0@lo:400:kworker.0 00000100:00100000:0.0:1787381381.470773:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065911168:12345-0@lo:400:kworker.0 Request processed in 7519us (11116us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381381.470792:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1787381381.475205:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a16750b6300 x1874205065911168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787381397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787381381.475225:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16750b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065911168:0@lo:400:kworker.0 00000100:00100000:2.0:1787381381.475253:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16750b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065910528:0@lo:400:kworker.0 00000100:00100000:2.0:1787381381.475289:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16750b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1874205065911040:0@lo:400:kworker.0 00000100:00100000:1.0:1787381381.964284:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787381381.964305:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a804a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065911424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787381381.964390:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381381.964557:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065911424 00000100:00100000:2.0:1787381381.964566:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065911424 00000100:00100000:2.0:1787381381.964612:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787381381.964620:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645b71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065911424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787381381.964651:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787381381.964691:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645b71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065911424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381381.964698:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1787381381.964774:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a804a80 x1874205065911424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381397 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381381.964801:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a804a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065911424:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787381382.029072:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787381382.571223:0:9183:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.115 00010000:00010000:3.0:1787381383.052386:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381384.079828:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787381384.328160:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381384.329565:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047005312 00000100:00100000:3.0:1787381384.329580:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047005312 00000100:00100000:3.0:1787381384.329651:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 200 00000100:00100000:3.0:1787381384.329661:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:2352:x1874205047005312:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381384.329746:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:2352:x1874205047005312:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 86us (1594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381384.329753:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 200 00000100:00100000:0.0:1787381384.330445:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381384.330521:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047005440 00000100:00100000:3.0:1787381384.330526:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047005440 00000100:00100000:3.0:1787381384.330580:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:3.0:1787381384.330588:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16750b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+6:2352:x1874205047005440:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381384.330642:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16750b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+6:2352:x1874205047005440:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 55us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381384.330650:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00080000:0.0:1787381384.331150:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787381385.100988:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787381385.242559:0:9281:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.115 00010000:00010000:3.0:1787381386.124330:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787381386.572427:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16750b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065911552:0@lo:400:kworker.0 00000100:00100000:3.0:1787381386.572503:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381386.572574:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787381386.572581:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a804700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065911680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787381386.572611:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381386.572633:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787381386.572642:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065911680 00000100:00100000:0.0:1787381386.572642:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16750b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874205065911808:0@lo:400:kworker.0 00000100:00100000:3.0:1787381386.572661:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065911680 00000100:00100000:0.0:1787381386.572670:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381386.572712:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787381386.572717:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16750b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1874205065911936:0@lo:400:kworker.0 00000100:00100000:3.0:1787381386.572720:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f6b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065911680:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787381386.572738:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1787381386.572762:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787381386.572822:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065911552 00000100:00100000:1.0:1787381386.572827:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065911552 00000100:00100000:1.0:1787381386.572858:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787381386.572873:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+19:3308:x1874205065911552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381386.572909:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+19:3308:x1874205065911552:12345-0@lo:400:kworker.0 Request processed in 36us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381386.572924:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787381386.572962:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065911808 00000100:00100000:1.0:1787381386.572965:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065911808 00000100:00100000:1.0:1787381386.572989:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065911936 00000100:00100000:1.0:1787381386.572992:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065911936 00000100:00100000:1.0:1787381386.573071:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787381386.573078:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16750b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874205065911808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381386.573117:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16750b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874205065911808:12345-0@lo:400:kworker.0 Request processed in 41us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381386.573123:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787381386.573135:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787381386.573141:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16750b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874205065911936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381386.573167:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16750b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874205065911936:12345-0@lo:400:kworker.0 Request processed in 27us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381386.573173:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787381386.573216:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16750b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1874205065911936:0@lo:400:kworker.0 00000100:00100000:1.0:1787381386.573226:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16750b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874205065911808:0@lo:400:kworker.0 00000100:00100000:3.0:1787381386.573304:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f6b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065911680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 584us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381386.573311:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1787381386.573329:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787381386.573333:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787381386.573343:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16750b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1874205065912064:0@lo:400:kworker.0 00000100:00100000:3.0:1787381386.573365:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787381386.573395:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a804700 x1874205065911680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787381386.573411:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a804700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065911680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787381386.573421:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16750b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065911552:0@lo:400:kworker.0 00000100:00100000:1.0:1787381386.573649:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065912064 00000100:00100000:1.0:1787381386.573653:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065912064 00000100:00100000:1.0:1787381386.573719:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787381386.573726:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f6b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874205065912064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381386.573775:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f6b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874205065912064:12345-0@lo:400:kworker.0 Request processed in 49us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381386.573788:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787381386.573816:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16750b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1874205065912064:0@lo:400:kworker.0 00000100:00080000:3.0:1787381386.574844:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787381386.575222:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16750b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065912192:0@lo:400:kworker.0 00000100:00100000:1.0:1787381386.575271:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381386.575911:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065912192 00000100:00100000:2.0:1787381386.575932:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065912192 00000100:00100000:2.0:1787381386.576055:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787381386.576065:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065912192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381386.576126:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065912192:12345-0@lo:400:kworker.0 Request processed in 63us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381386.576133:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1787381386.576252:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a16750b6a00 x1874205065912192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787381402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381386.576265:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16750b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065912192:0@lo:400:kworker.0 00000100:00080000:3.0:1787381386.577046:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:1.0:1787381387.032809:0:9329:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Aug 22 02:49:44 EDT 2026 00000100:00100000:1.0:1787381387.085659:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a805c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065912320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787381387.086357:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381387.087641:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065912320 00000100:00100000:0.0:1787381387.087652:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065912320 00000100:00100000:0.0:1787381387.087711:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787381387.087721:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645b73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065912320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787381387.087779:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787381387.087845:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645b73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065912320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (1489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381387.087852:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1787381387.088431:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a805c00 x1874205065912320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381403 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787381387.088625:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a805c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065912320:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787381387.148287:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381388.173662:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381389.196270:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787381389.456346:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381389.456398:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381389.458426:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047005696 00000100:00100000:3.0:1787381389.458441:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047005696 00000100:00100000:3.0:1787381389.458519:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 51 00000100:00100000:3.0:1787381389.458529:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+6:2350:x1874205047005696:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381389.458604:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a805c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+6:2350:x1874205047005696:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 76us (2266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381389.458611:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 51 00000100:00080000:3.0:1787381389.458635:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787381389.462810:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047005568 00000100:00100000:0.0:1787381389.462823:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047005568 00000100:00100000:0.0:1787381389.462884:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 202 00000100:00100000:0.0:1787381389.462894:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:2350:x1874205047005568:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787381389.462967:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:2350:x1874205047005568:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 74us (6568us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381389.462975:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 202 00010000:00010000:3.0:1787381390.220262:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381391.245572:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787381391.692315:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065912448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787381391.692375:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381391.694041:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065912448 00000100:00100000:0.0:1787381391.694052:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065912448 00000100:00100000:0.0:1787381391.694130:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787381391.694141:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645b72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065912448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787381391.694173:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787381391.694338:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1645b70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1874205065912960:0@lo:400:kworker.0 00000100:00100000:1.0:1787381391.694381:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381391.694425:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787381391.694431:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1645b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1874205065912832:0@lo:400:kworker.0 00000100:00100000:1.0:1787381391.694452:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381391.694477:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065912960 00000100:00100000:1.0:1787381391.694481:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065912960 00000100:00100000:1.0:1787381391.694507:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065912832 00000100:00100000:1.0:1787381391.694509:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065912832 00000100:00100000:1.0:1787381391.694540:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787381391.694546:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645b70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874205065912960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381391.694596:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645b70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874205065912960:12345-0@lo:400:kworker.0 Request processed in 50us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381391.694603:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787381391.694619:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787381391.694864:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874205065912832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381391.694906:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874205065912832:12345-0@lo:400:kworker.0 Request processed in 34us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381391.694912:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787381391.694949:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1645b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1874205065912832:0@lo:400:kworker.0 00000100:00100000:1.0:1787381391.694960:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1645b70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1874205065912960:0@lo:400:kworker.0 00000100:00100000:1.0:1787381391.695038:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1645b73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874205065912704:0@lo:400:kworker.0 00000100:00100000:1.0:1787381391.695063:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381391.695083:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787381391.695089:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1645b71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd19486c-5291-4823-bb9c-f3a73416a496:3309:1874205065912576:0@lo:400:kworker.0 00000100:00100000:1.0:1787381391.695115:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381391.695138:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1645b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065913088:0@lo:400:kworker.0 00000100:00100000:1.0:1787381391.695158:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381391.695181:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065912576 00000100:00100000:1.0:1787381391.695185:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065912576 00000100:00100000:1.0:1787381391.695223:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787381391.695230:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+19:3309:x1874205065912576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381391.695262:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+19:3309:x1874205065912576:12345-0@lo:400:kworker.0 Request processed in 32us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381391.695268:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1787381391.695298:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1645b71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd19486c-5291-4823-bb9c-f3a73416a496:3309:1874205065912576:0@lo:400:kworker.0 00000100:00100000:1.0:1787381391.695311:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065912704 00000100:00100000:1.0:1787381391.695314:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065912704 00000100:00100000:1.0:1787381391.695328:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787381391.695333:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874205065912704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381391.695366:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645b70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874205065912704:12345-0@lo:400:kworker.0 Request processed in 32us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381391.695371:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787381391.695393:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1645b73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874205065912704:0@lo:400:kworker.0 00000100:00100000:2.0:1787381391.695796:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065913088 00000100:00100000:2.0:1787381391.695800:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065913088 00000100:00100000:2.0:1787381391.695837:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787381391.695843:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065913088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381391.695898:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065913088:12345-0@lo:400:kworker.0 Request processed in 47us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381391.695905:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1787381391.695929:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a1645b71180 x1874205065913088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787381407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787381391.695940:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1645b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065913088:0@lo:400:kworker.0 00000100:00080000:3.0:1787381391.696049:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787381391.696054:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787381391.696056:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787381391.696237:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645b72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065912448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2097us (3860us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381391.696245:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1787381391.696346:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a807480 x1874205065912448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381407 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787381391.696362:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065912448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787381392.204759:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065913216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787381392.204827:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381392.204971:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065913216 00000100:00100000:3.0:1787381392.204981:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065913216 00000100:00100000:3.0:1787381392.205052:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787381392.205062:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645b73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065913216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787381392.205097:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787381392.216015:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645b73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065913216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10933us (11165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381392.216031:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1787381392.217408:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a807480 x1874205065913216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381408 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381392.217433:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065913216:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787381392.287624:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381393.292231:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381394.316638:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787381394.568987:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381394.569089:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381394.569120:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047005952 00000100:00100000:3.0:1787381394.569129:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047005952 00000100:00100000:3.0:1787381394.569195:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:3.0:1787381394.569205:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f6bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+6:2350:x1874205047005952:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381394.569276:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f6bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+6:2350:x1874205047005952:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 73us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381394.569284:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00080000:3.0:1787381394.569305:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787381394.569755:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047005824 00000100:00100000:0.0:1787381394.569761:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047005824 00000100:00100000:0.0:1787381394.569800:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 204 00000100:00100000:0.0:1787381394.569808:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:2349:x1874205047005824:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787381394.569847:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:2349:x1874205047005824:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 40us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381394.569865:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 204 00010000:00010000:2.0:1787381395.340703:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381396.364216:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787381396.812692:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a807100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065913344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787381396.812763:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381396.812914:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065913344 00000100:00100000:1.0:1787381396.812924:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065913344 00000100:00100000:1.0:1787381396.812991:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787381396.813035:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f6ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065913344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787381396.813091:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787381396.813851:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f6ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065913344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 850us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381396.813862:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1787381396.813923:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a807100 x1874205065913344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381412 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787381396.813943:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a807100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065913344:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787381396.814845:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd19486c-5291-4823-bb9c-f3a73416a496:3311:1874205065913472:0@lo:400:kworker.0 00000100:00100000:2.0:1787381396.814898:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381396.815281:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787381396.815289:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1874205065913856:0@lo:400:kworker.0 00000100:00100000:2.0:1787381396.815319:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381396.815559:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065913856 00000100:00100000:1.0:1787381396.815567:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065913856 00000100:00100000:1.0:1787381396.815617:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787381396.815628:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874205065913856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381396.815695:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a806d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874205065913856:12345-0@lo:400:kworker.0 Request processed in 70us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381396.815703:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787381396.815876:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1874205065913856:0@lo:400:kworker.0 00000100:00100000:2.0:1787381396.815904:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065913472 00000100:00100000:2.0:1787381396.815907:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065913472 00000100:00100000:2.0:1787381396.815945:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787381396.815952:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+19:3311:x1874205065913472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381396.815988:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+19:3311:x1874205065913472:12345-0@lo:400:kworker.0 Request processed in 37us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381396.815994:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1787381396.816285:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd19486c-5291-4823-bb9c-f3a73416a496:3311:1874205065913472:0@lo:400:kworker.0 00000100:00080000:2.0:1787381396.816646:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787381396.816652:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787381396.816852:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065913984:0@lo:400:kworker.0 00000100:00100000:2.0:1787381396.816890:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381396.816955:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874205065913600:0@lo:400:kworker.0 00000100:00100000:3.0:1787381396.816986:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381396.817038:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787381396.817200:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065913984 00000100:00100000:1.0:1787381396.817215:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065913984 00000100:00100000:1.0:1787381396.817267:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787381396.817276:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065913984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787381396.817577:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1874205065913728:0@lo:400:kworker.0 00000100:00100000:3.0:1787381396.817607:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381396.817641:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065913600 00000100:00100000:3.0:1787381396.817645:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065913600 00000100:00100000:3.0:1787381396.817689:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065913728 00000100:00100000:3.0:1787381396.817692:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065913728 00000100:00100000:3.0:1787381396.817711:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787381396.817717:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f6bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874205065913600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787381396.817752:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f6bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874205065913600:12345-0@lo:400:kworker.0 Request processed in 35us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381396.817759:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787381396.817774:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787381396.817780:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f6bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874205065913728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787381396.817808:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f6bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874205065913728:12345-0@lo:400:kworker.0 Request processed in 29us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381396.817813:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787381396.817850:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1874205065913728:0@lo:400:kworker.0 00000100:00100000:3.0:1787381396.817859:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874205065913600:0@lo:400:kworker.0 00000100:00100000:1.0:1787381396.818630:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a807100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065913984:12345-0@lo:400:kworker.0 Request processed in 1353us (1737us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381396.818640:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1787381396.818746:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167f6b8a80 x1874205065913984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787381412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787381396.818759:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065913984:0@lo:400:kworker.0 00000100:00080000:2.0:1787381396.818780:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787381396.818785:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787381397.326960:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787381397.326982:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065914112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787381397.327069:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381397.327129:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065914112 00000100:00100000:2.0:1787381397.327137:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065914112 00000100:00100000:2.0:1787381397.327183:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787381397.327191:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065914112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787381397.327224:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787381397.327266:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a804700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065914112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381397.327273:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1787381397.327314:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a807480 x1874205065914112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381413 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787381397.327332:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065914112:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787381397.394034:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381398.422371:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381399.436529:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787381399.692295:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381399.692443:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381399.694092:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047006080 00000100:00100000:3.0:1787381399.694104:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047006080 00000100:00100000:3.0:1787381399.694165:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 206 00000100:00100000:3.0:1787381399.694175:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:2352:x1874205047006080:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381399.694256:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:2352:x1874205047006080:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 82us (1967us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381399.694264:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 206 00000100:00100000:1.0:1787381399.696472:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047006208 00000100:00100000:1.0:1787381399.696485:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047006208 00000100:00100000:1.0:1787381399.696555:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 59 00000100:00100000:1.0:1787381399.696565:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16750b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+6:2352:x1874205047006208:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787381399.696639:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16750b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+6:2352:x1874205047006208:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 75us (4261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381399.696647:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 59 00000100:00080000:3.0:1787381399.697095:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787381400.460301:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381401.485035:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787381401.932246:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874205065914368:0@lo:400:kworker.0 00000100:00100000:3.0:1787381401.932308:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381401.932377:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065914880:0@lo:400:kworker.0 00000100:00100000:3.0:1787381401.932401:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381401.932430:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787381401.932435:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1874205065914496:0@lo:400:kworker.0 00000100:00100000:3.0:1787381401.932475:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381401.932793:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065915008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787381401.932821:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381401.932863:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065915008 00000100:00100000:2.0:1787381401.932871:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065915008 00000100:00100000:2.0:1787381401.932920:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787381401.932922:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd19486c-5291-4823-bb9c-f3a73416a496:3309:1874205065914240:0@lo:400:kworker.0 00000100:00100000:2.0:1787381401.932928:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a804a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065915008:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787381401.932958:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1787381401.932960:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787381401.932982:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1874205065914752:0@lo:400:kworker.0 00000100:00100000:2.0:1787381401.932997:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a804a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065915008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381401.933024:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787381401.933043:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381401.933059:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00080000:2.0:1787381401.933060:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a807480 x1874205065915008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381401.933064:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065914624:0@lo:400:kworker.0 00000100:00100000:2.0:1787381401.933078:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065915008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787381401.933082:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381401.933106:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065914368 00000100:00100000:2.0:1787381401.933110:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065914368 00000100:00100000:0.0:1787381401.933115:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065914240 00000100:00100000:0.0:1787381401.933118:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065914240 00000100:00100000:2.0:1787381401.933133:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065914496 00000100:00100000:2.0:1787381401.933135:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065914496 00000100:00100000:0.0:1787381401.933140:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1787381401.933145:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+19:3309:x1874205065914240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381401.933147:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065914752 00000100:00100000:2.0:1787381401.933149:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065914752 00000100:00100000:2.0:1787381401.933161:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787381401.933166:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874205065914368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381401.933178:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+19:3309:x1874205065914240:12345-0@lo:400:kworker.0 Request processed in 32us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381401.933193:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874205065914368:12345-0@lo:400:kworker.0 Request processed in 27us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381401.933195:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1787381401.933199:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787381401.933209:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787381401.933214:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fb26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874205065914496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381401.933238:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fb26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874205065914496:12345-0@lo:400:kworker.0 Request processed in 24us (763us total) trans 0 rc 0/0 00000100:00080000:0.0:1787381401.933243:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787381401.933247:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787381401.933250:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787381401.933255:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065914880 00000100:00100000:0.0:1787381401.933258:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065914880 00000100:00100000:2.0:1787381401.933260:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787381401.933265:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16750b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874205065914752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381401.933280:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065914624 00000100:00100000:0.0:1787381401.933283:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065914624 00000100:00100000:2.0:1787381401.933290:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16750b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874205065914752:12345-0@lo:400:kworker.0 Request processed in 25us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381401.933296:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787381401.933296:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787381401.933301:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065914880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381401.933312:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787381401.933318:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16750b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065914624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381401.933341:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16750b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065914624:12345-0@lo:400:kworker.0 Request processed in 22us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381401.933341:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065914880:12345-0@lo:400:kworker.0 Request processed in 39us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381401.933347:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787381401.933350:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1787381401.933366:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787381401.933378:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1874205065914496:0@lo:400:kworker.0 00010000:00080000:0.0:1787381401.933378:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167f6b9c00 x1874205065914624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787381417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787381401.933387:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874205065914368:0@lo:400:kworker.0 00010000:00080000:2.0:1787381401.933396:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a1674ed7b80 x1874205065914880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787381417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381401.933398:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065914624:0@lo:400:kworker.0 00000100:00100000:2.0:1787381401.933404:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065914880:0@lo:400:kworker.0 00000100:00100000:0.0:1787381401.933406:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd19486c-5291-4823-bb9c-f3a73416a496:3309:1874205065914240:0@lo:400:kworker.0 00000100:00100000:0.0:1787381401.933414:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1874205065914752:0@lo:400:kworker.0 00000100:00100000:3.0:1787381402.444270:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787381402.444298:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065915136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787381402.444370:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381402.444491:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065915136 00000100:00100000:2.0:1787381402.444499:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065915136 00000100:00100000:2.0:1787381402.444554:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787381402.444564:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fb25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065915136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787381402.444601:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787381402.444656:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fb25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065915136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381402.444678:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1787381402.444758:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a807480 x1874205065915136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381418 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787381402.444775:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065915136:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787381402.508218:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787381402.999218:0:9959:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 02:50:00 (1787381400) === 00000100:00100000:0.0:1787381403.413611:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381403.413918:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047006336 00000100:00100000:2.0:1787381403.413933:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047006336 00000100:00100000:2.0:1787381403.414089:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 208 00000100:00100000:2.0:1787381403.414101:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:8100:x1874205047006336:12345-192.168.203.22@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787381403.414124:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381403.414148:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1681732200/0xbdc38ada7ea0f9e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc01952459a953639 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381403.414190:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1681732200/0xbdc38ada7ea0f9e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953639 expref: 11 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381403.414204:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1681732200/0xbdc38ada7ea0f9e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953639 expref: 11 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381403.414215:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1681732200, rc 0) 00000100:00100000:2.0:1787381403.414413:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+11:8100:x1874205047006336:12345-192.168.203.22@tcp:101:mount.lustre.0 Request processed in 314us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381403.414422:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 208 00000100:00100000:1.0:1787381403.430822:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381403.432193:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047006464 00000100:00100000:0.0:1787381403.432213:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047006464 00000100:00100000:0.0:1787381403.432303:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 209 00000100:00100000:0.0:1787381403.432316:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646169c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+11:8100:x1874205047006464:12345-192.168.203.22@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787381403.432760:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646169c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+11:8100:x1874205047006464:12345-192.168.203.22@tcp:501:mount.lustre.0 Request processed in 444us (1951us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381403.432769:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 209 00000100:00100000:3.0:1787381403.436078:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381403.436542:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047006592 00000100:00100000:2.0:1787381403.436554:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047006592 00000100:00100000:2.0:1787381403.436724:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 210 00000100:00100000:2.0:1787381403.436735:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+11:8100:x1874205047006592:12345-192.168.203.22@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787381403.436974:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+11:8100:x1874205047006592:12345-192.168.203.22@tcp:503:mount.lustre.0 Request processed in 239us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381403.436981:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 210 00000100:00100000:3.0:1787381403.442905:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381403.443094:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047006720 00000100:00100000:1.0:1787381403.443114:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047006720 00000100:00100000:1.0:1787381403.443203:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 211 00000100:00100000:1.0:1787381403.443215:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+11:8104:x1874205047006720:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787381403.443624:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+11:8104:x1874205047006720:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 410us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381403.443644:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 211 00000100:00100000:0.0:1787381403.457946:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381403.458039:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047006848 00000100:00100000:3.0:1787381403.458049:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047006848 00000100:00100000:3.0:1787381403.458102:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 212 00000100:00100000:3.0:1787381403.458112:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+11:8104:x1874205047006848:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787381403.458427:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+11:8104:x1874205047006848:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 315us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381403.458450:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 212 00000100:00100000:3.0:1787381403.480590:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381403.480910:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047006976 00000100:00100000:2.0:1787381403.480920:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047006976 00000100:00100000:2.0:1787381403.480974:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 213 00000100:00100000:2.0:1787381403.480983:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+11:8100:x1874205047006976:12345-192.168.203.22@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787381403.480999:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381403.481056:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1681733e00/0xbdc38ada7ea0f9e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc01952459a953663 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381403.481091:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1681733e00/0xbdc38ada7ea0f9e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953663 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381403.481102:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1681733e00/0xbdc38ada7ea0f9e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953663 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381403.481111:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1681733e00, rc 0) 00000100:00100000:2.0:1787381403.481171:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+12:8100:x1874205047006976:12345-192.168.203.22@tcp:101:mount.lustre.0 Request processed in 189us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381403.481178:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 213 00000100:00100000:0.0:1787381403.489316:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381403.489399:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047007104 00000100:00100000:3.0:1787381403.489408:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047007104 00000100:00100000:3.0:1787381403.489462:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 214 00000100:00100000:3.0:1787381403.489470:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+12:8100:x1874205047007104:12345-192.168.203.22@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787381403.489497:0:5785:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787381403.489522:0:5785:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787381403.489526:0:5785:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787381403.489530:0:5785:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787381403.489533:0:5785:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1787381403.501670:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+12:8100:x1874205047007104:12345-192.168.203.22@tcp:256:mount.lustre.0 Request processed in 12190us (12352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381403.501684:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 214 00000100:00100000:2.0:1787381403.516564:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381403.517324:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047007232 00000100:00100000:1.0:1787381403.517429:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047007232 00000100:00100000:1.0:1787381403.517528:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 215 00000100:00100000:1.0:1787381403.517552:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+12:8100:x1874205047007232:12345-192.168.203.22@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787381403.517571:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381403.517604:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1541388800/0xbdc38ada7ea0f9ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc01952459a95366a expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381403.517644:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1541388800/0xbdc38ada7ea0f9ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95366a expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381403.517658:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1541388800/0xbdc38ada7ea0f9ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95366a expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381403.517667:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541388800, rc 0) 00000100:00100000:1.0:1787381403.518379:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:8100:x1874205047007232:12345-192.168.203.22@tcp:101:mount.lustre.0 Request processed in 826us (1823us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381403.518388:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 215 00000100:00100000:0.0:1787381403.521288:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381403.521640:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047007360 00000100:00100000:1.0:1787381403.521648:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047007360 00000100:00100000:1.0:1787381403.521702:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 216 00000100:00100000:1.0:1787381403.521711:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646168850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:8100:x1874205047007360:12345-192.168.203.22@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787381403.522044:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646168850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:8100:x1874205047007360:12345-192.168.203.22@tcp:501:mount.lustre.0 Request processed in 333us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381403.522052:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 216 00000100:00100000:0.0:1787381403.525072:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381403.525178:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047007488 00000100:00100000:1.0:1787381403.525187:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047007488 00000100:00100000:1.0:1787381403.525237:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 217 00000100:00100000:1.0:1787381403.525245:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:8100:x1874205047007488:12345-192.168.203.22@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787381403.525460:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:8100:x1874205047007488:12345-192.168.203.22@tcp:503:mount.lustre.0 Request processed in 214us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381403.525475:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 217 00000100:00100000:3.0:1787381403.531506:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381403.532239:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047007616 00000100:00100000:2.0:1787381403.532252:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047007616 00000100:00100000:2.0:1787381403.532332:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 218 00000100:00100000:2.0:1787381403.532342:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:8108:x1874205047007616:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787381403.532599:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:8108:x1874205047007616:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 257us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381403.532606:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 218 00010000:00010000:1.0:1787381403.533030:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787381403.539226:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381403.541696:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047007744 00000100:00100000:3.0:1787381403.541710:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047007744 00000100:00100000:3.0:1787381403.541776:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 219 00000100:00100000:3.0:1787381403.541787:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:8108:x1874205047007744:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787381403.542063:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:8108:x1874205047007744:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 277us (2846us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381403.542071:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 219 00000100:00100000:3.0:1787381403.547488:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381403.547587:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047008256 00000100:00100000:2.0:1787381403.547610:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047008256 00000100:00100000:2.0:1787381403.547698:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 63 00000100:00100000:2.0:1787381403.547708:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fb24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+6:2351:x1874205047008256:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787381403.547796:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fb24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+6:2351:x1874205047008256:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 85us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381403.547804:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 63 00000100:00080000:0.0:1787381403.547868:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787381403.549802:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381403.549888:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047007872 00000100:00100000:3.0:1787381403.549896:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047007872 00000100:00100000:3.0:1787381403.549938:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:3.0:1787381403.549959:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16750b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2348:x1874205047007872:12345-192.168.203.22@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787381403.549988:0:5790:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 76f8c15f-81f9-4e6f-a311-d4cb5f530dfa@192.168.203.22@tcp t0 exp 0000000000000000 cur 261 last 0 00000020:00000080:3.0:1787381403.550051:0:5790:0:(genops.c:1406:class_connect()) connect: client 76f8c15f-81f9-4e6f-a311-d4cb5f530dfa, cookie 0xbdc38ada7ea0f9f5 00000004:00100000:3.0:1787381403.550081:0:5790:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787381403.550345:0:5790:0:(import.c:65:import_set_state_nolock()) ffff9a1675367800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787381403.550402:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16750b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+6:2348:x1874205047007872:12345-192.168.203.22@tcp:38:mount.lustre.0 Request processed in 442us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381403.550410:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:1.0:1787381403.556392:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381403.556473:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381403.556690:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047008000 00000100:00100000:3.0:1787381403.556699:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047008000 00000100:00100000:3.0:1787381403.556763:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047008128 00000100:00100000:3.0:1787381403.556766:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047008128 00000100:00100000:3.0:1787381403.556798:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:3.0:1787381403.556807:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+7:0:x1874205047008000:12345-192.168.203.22@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787381403.556851:0:8469:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787381403.556928:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+7:0:x1874205047008000:12345-192.168.203.22@tcp:41:mount.lustre.0 Request processed in 122us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381403.556935:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:3.0:1787381403.556952:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:3.0:1787381403.556959:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+6:8100:x1874205047008128:12345-192.168.203.22@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787381403.556969:0:8469:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787381403.556992:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+6:8100:x1874205047008128:12345-192.168.203.22@tcp:41:mount.lustre.0 Request processed in 33us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381403.556998:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00080000:0.0:1787381403.557514:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787381403.559509:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381403.559626:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047008384 00000100:00100000:3.0:1787381403.559655:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047008384 00000100:00100000:3.0:1787381403.559706:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:3.0:1787381403.559715:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16750b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+6:8100:x1874205047008384:12345-192.168.203.22@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787381403.560430:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16750b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+6:8100:x1874205047008384:12345-192.168.203.22@tcp:40:mount.lustre.0 Request processed in 711us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381403.560439:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:0.0:1787381403.568493:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381403.568533:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381403.568557:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381403.568616:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047008768 00000100:00100000:1.0:1787381403.568625:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047008768 00000100:00100000:1.0:1787381403.568681:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:1.0:1787381403.568690:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+6:8100:x1874205047008768:12345-192.168.203.22@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787381403.568914:0:5793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787381403.569061:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+6:8100:x1874205047008768:12345-192.168.203.22@tcp:33:mount.lustre.0 Request processed in 370us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381403.569068:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:3.0:1787381403.574882:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047008512 00000100:00100000:3.0:1787381403.574897:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047008512 00000100:00100000:3.0:1787381403.574941:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047008640 00000100:00100000:3.0:1787381403.574944:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047008640 00000100:00100000:3.0:1787381403.574966:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:3.0:1787381403.574977:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f922300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2348:x1874205047008512:12345-192.168.203.22@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787381403.575025:0:7779:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 76f8c15f-81f9-4e6f-a311-d4cb5f530dfa@192.168.203.22@tcp t0 exp 0000000000000000 cur 261 last 0 00000020:00000080:3.0:1787381403.575059:0:7779:0:(genops.c:1406:class_connect()) connect: client 76f8c15f-81f9-4e6f-a311-d4cb5f530dfa, cookie 0xbdc38ada7ea0f9fc 00002000:00100000:3.0:1787381403.575070:0:7779:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 76f8c15f-81f9-4e6f-a311-d4cb5f530dfa/ffff9a1675364000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113673 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787381403.575080:0:7779:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787381403.575832:0:7779:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787381403.575872:0:7779:0:(import.c:65:import_set_state_nolock()) ffff9a1675365800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787381403.575982:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f922300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+6:2348:x1874205047008512:12345-192.168.203.22@tcp:8:mount.lustre.0 Request processed in 1005us (7446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381403.575992:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:3.0:1787381403.576042:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:3.0:1787381403.576048:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f921f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2348:x1874205047008640:12345-192.168.203.22@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787381403.576066:0:7779:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 76f8c15f-81f9-4e6f-a311-d4cb5f530dfa@192.168.203.22@tcp t0 exp 0000000000000000 cur 261 last 0 00000020:00000080:3.0:1787381403.576085:0:7779:0:(genops.c:1406:class_connect()) connect: client 76f8c15f-81f9-4e6f-a311-d4cb5f530dfa, cookie 0xbdc38ada7ea0fa03 00002000:00100000:3.0:1787381403.576107:0:7779:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 76f8c15f-81f9-4e6f-a311-d4cb5f530dfa/ffff9a1675361800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113673 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787381403.576115:0:7779:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787381403.576269:0:7779:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787381403.576285:0:7779:0:(import.c:65:import_set_state_nolock()) ffff9a1675362800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787381403.576321:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f921f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+6:2348:x1874205047008640:12345-192.168.203.22@tcp:8:mount.lustre.0 Request processed in 272us (7762us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381403.576328:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 13 00000001:00100000:1.0:1787381404.051948:0:5813:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 76f8c15f-81f9-4e6f-a311-d4cb5f530dfa 00000001:00100000:2.0:1787381404.064877:0:7481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 76f8c15f-81f9-4e6f-a311-d4cb5f530dfa 00010000:00010000:2.0:1787381404.556361:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787381405.096509:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 76f8c15f-81f9-4e6f-a311-d4cb5f530dfa 00010000:00010000:0.0:1787381405.581264:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381406.604144:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787381407.052361:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a806300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065915264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787381407.052426:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381407.052492:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065915264 00000100:00100000:3.0:1787381407.052499:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065915264 00000100:00100000:3.0:1787381407.052543:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787381407.052551:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fb27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065915264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787381407.052581:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787381407.052696:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fb27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065915264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381407.052703:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1787381407.052798:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a806300 x1874205065915264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787381407.052816:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a806300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065915264:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787381407.053355:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787381407.053390:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1645b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd19486c-5291-4823-bb9c-f3a73416a496:3310:1874205065915392:0@lo:400:kworker.0 00000100:00100000:1.0:1787381407.053437:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1645b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874205065915520:0@lo:400:kworker.0 00000100:00100000:0.0:1787381407.053444:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381407.053479:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381407.053485:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1645b73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065915904:0@lo:400:kworker.0 00000100:00100000:1.0:1787381407.053516:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065915520 00000100:00100000:1.0:1787381407.053521:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065915520 00000100:00100000:1.0:1787381407.053557:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787381407.053565:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645b73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874205065915520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381407.054237:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381407.054296:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065915392 00000100:00100000:0.0:1787381407.054302:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065915392 00000100:00100000:1.0:1787381407.054332:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645b73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874205065915520:12345-0@lo:400:kworker.0 Request processed in 765us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381407.054341:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1787381407.054344:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787381407.054352:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+19:3310:x1874205065915392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381407.054392:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1645b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874205065915520:0@lo:400:kworker.0 00000100:00100000:0.0:1787381407.054404:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+19:3310:x1874205065915392:12345-0@lo:400:kworker.0 Request processed in 53us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381407.054413:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787381407.054424:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065915904 00000100:00100000:1.0:1787381407.054428:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1645b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1874205065915776:0@lo:400:kworker.0 00000100:00100000:3.0:1787381407.054429:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065915904 00000100:00100000:1.0:1787381407.054467:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381407.054470:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1787381407.054473:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787381407.054480:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f920700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065915904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381407.054490:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1645b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1874205065915648:0@lo:400:kworker.0 00000100:00100000:1.0:1787381407.054500:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065915776 00000100:00100000:1.0:1787381407.054505:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065915776 00000100:00100000:3.0:1787381407.054516:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f920700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065915904:12345-0@lo:400:kworker.0 Request processed in 40us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381407.054529:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787381407.054533:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787381407.054540:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874205065915776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381407.054546:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381407.054585:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874205065915776:12345-0@lo:400:kworker.0 Request processed in 45us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381407.054593:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1787381407.054593:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787381407.054619:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065915648 00000100:00100000:1.0:1787381407.054624:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065915648 00010000:00080000:0.0:1787381407.054626:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a1645b73480 x1874205065915904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787381423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381407.054639:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1645b73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065915904:0@lo:400:kworker.0 00000100:00100000:0.0:1787381407.054652:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1645b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd19486c-5291-4823-bb9c-f3a73416a496:3310:1874205065915392:0@lo:400:kworker.0 00000100:00100000:1.0:1787381407.054656:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787381407.054666:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874205065915648:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787381407.054677:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787381407.054715:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874205065915648:12345-0@lo:400:kworker.0 Request processed in 50us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381407.054721:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787381407.054753:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1645b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1874205065915776:0@lo:400:kworker.0 00000100:00100000:0.0:1787381407.057717:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1645b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1874205065915648:0@lo:400:kworker.0 00000100:00100000:0.0:1787381407.569213:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787381407.569250:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065916032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787381407.569336:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381407.569631:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065916032 00000100:00100000:3.0:1787381407.569641:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065916032 00000100:00100000:3.0:1787381407.569699:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787381407.569710:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f923800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065916032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787381407.569751:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787381407.569826:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f923800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065916032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381407.569832:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1787381407.570168:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a804380 x1874205065916032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381407.570189:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065916032:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787381407.628263:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381408.652455:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787381408.903569:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381408.903612:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381408.903646:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381408.903664:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381408.903705:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381408.903734:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047009152 00000100:00100000:1.0:1787381408.903744:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047009152 00000100:00100000:1.0:1787381408.903809:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047009024 00000100:00100000:1.0:1787381408.903812:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047009024 00000100:00100000:1.0:1787381408.903835:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 67 00000100:00100000:1.0:1787381408.903843:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2352:x1874205047009152:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787381408.903925:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2352:x1874205047009152:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 81us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381408.903934:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 67 00000100:00100000:1.0:1787381408.903952:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 68 00000100:00100000:1.0:1787381408.903958:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+6:2352:x1874205047009024:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787381408.903983:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+6:2352:x1874205047009024:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 25us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381408.903989:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 68 00000100:00100000:1.0:1787381408.904029:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047009408 00000100:00100000:1.0:1787381408.904033:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047009408 00000100:00100000:1.0:1787381408.904056:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047009280 00000100:00100000:1.0:1787381408.904059:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047009280 00000100:00100000:1.0:1787381408.904076:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 32 00000100:00100000:1.0:1787381408.904083:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645b71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2352:x1874205047009408:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787381408.904109:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645b71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2352:x1874205047009408:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 26us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381408.904115:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 32 00000100:00100000:1.0:1787381408.904127:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 33 00000100:00100000:1.0:1787381408.904133:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2352:x1874205047009280:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787381408.904155:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2352:x1874205047009280:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 23us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381408.904161:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 33 00000100:00080000:1.0:1787381408.904177:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787381408.904181:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787381408.904183:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787381408.904581:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047008896 00000100:00100000:0.0:1787381408.904587:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047008896 00000100:00100000:0.0:1787381408.904628:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 221 00000100:00100000:0.0:1787381408.904634:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646168c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2352:x1874205047008896:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787381408.904661:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646168c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2352:x1874205047008896:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 28us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381408.904668:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 221 00000001:02000400:3.0:1787381409.342468:0:10159:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1787381409.676430:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381410.700128:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381411.724487:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787381412.176454:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a806300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874205065916288:0@lo:400:kworker.0 00000100:00100000:1.0:1787381412.176658:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381412.176753:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065916160:0@lo:400:kworker.0 00000100:00100000:0.0:1787381412.176792:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381412.176843:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1874205065916672:0@lo:400:kworker.0 00000100:00100000:0.0:1787381412.176873:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1874205065916416:0@lo:400:kworker.0 00000100:00100000:0.0:1787381412.176908:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065916160 00000100:00100000:0.0:1787381412.176916:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065916160 00000100:00100000:0.0:1787381412.176973:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1787381412.176982:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+19:3308:x1874205065916160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381412.177060:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+19:3308:x1874205065916160:12345-0@lo:400:kworker.0 Request processed in 78us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381412.177081:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1787381412.177406:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065916800:0@lo:400:kworker.0 00000100:00100000:1.0:1787381412.177449:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381412.177485:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065916544:0@lo:400:kworker.0 00000100:00100000:1.0:1787381412.177659:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381412.177712:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065916800 00000100:00100000:1.0:1787381412.177718:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065916800 00000100:00100000:1.0:1787381412.177769:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065916544 00000100:00100000:1.0:1787381412.177773:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065916544 00000100:00100000:1.0:1787381412.177793:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787381412.177807:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f563b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065916800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381412.177853:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f563b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065916800:12345-0@lo:400:kworker.0 Request processed in 54us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381412.177867:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787381412.177882:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787381412.177889:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f562a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065916544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381412.177936:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f562a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065916544:12345-0@lo:400:kworker.0 Request processed in 47us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381412.177942:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1787381412.177966:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787381412.177970:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787381412.178025:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167f6baa00 x1874205065916800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787381428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381412.178040:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065916800:0@lo:400:kworker.0 00010000:00080000:1.0:1787381412.178081:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a1674ed7b80 x1874205065916544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787381428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381412.178104:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065916544:0@lo:400:kworker.0 00000100:00100000:1.0:1787381412.178131:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381412.180685:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787381412.180704:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166fb27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065916928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787381412.180846:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381412.180993:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065916928 00000100:00100000:3.0:1787381412.181000:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065916928 00000100:00100000:3.0:1787381412.181433:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787381412.181441:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fb25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065916928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787381412.181472:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787381412.181526:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fb25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065916928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381412.181532:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1787381412.181568:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a166fb27800 x1874205065916928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787381412.181597:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166fb27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065916928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787381412.187932:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381412.190283:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065916288 00000100:00100000:2.0:1787381412.190306:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065916288 00000100:00100000:2.0:1787381412.191235:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065916416 00000100:00100000:2.0:1787381412.191253:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065916416 00000100:00080000:2.0:1787381412.191282:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787381412.191319:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787381412.191329:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874205065916288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381412.191420:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874205065916288:12345-0@lo:400:kworker.0 Request processed in 93us (14762us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381412.191427:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787381412.191472:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a806300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874205065916288:0@lo:400:kworker.0 00000100:00100000:2.0:1787381412.191501:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787381412.191508:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f560e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874205065916416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381412.191541:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f560e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874205065916416:12345-0@lo:400:kworker.0 Request processed in 34us (13415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381412.191547:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787381412.195729:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065916160:0@lo:400:kworker.0 00000100:00100000:1.0:1787381412.195788:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a807480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1874205065916416:0@lo:400:kworker.0 00000100:00100000:1.0:1787381412.195814:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065916672 00000100:00100000:1.0:1787381412.195820:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065916672 00000100:00080000:1.0:1787381412.195857:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787381412.195897:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787381412.195906:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874205065916672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381412.195973:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874205065916672:12345-0@lo:400:kworker.0 Request processed in 67us (8047us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381412.195980:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787381412.196126:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1874205065916672:0@lo:400:kworker.0 00000100:00100000:2.0:1787381412.684480:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787381412.684502:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065917056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787381412.684579:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381412.684706:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065917056 00000100:00100000:2.0:1787381412.684714:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065917056 00000100:00100000:2.0:1787381412.684771:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787381412.684780:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f6b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065917056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787381412.686702:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787381412.687332:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f6b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065917056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2550us (2760us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381412.687342:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1787381412.687395:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167f6b9c00 x1874205065917056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787381412.687416:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065917056:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787381412.751250:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381413.772208:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787381414.028062:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381414.028102:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381414.028128:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381414.028148:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381414.028170:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381414.028199:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047009792 00000100:00100000:1.0:1787381414.028209:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047009792 00000100:00100000:1.0:1787381414.028262:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047009664 00000100:00100000:1.0:1787381414.028266:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047009664 00000100:00100000:1.0:1787381414.028288:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 72 00000100:00100000:1.0:1787381414.028297:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2351:x1874205047009792:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787381414.028379:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2351:x1874205047009792:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 82us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381414.028387:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 72 00000100:00100000:1.0:1787381414.028406:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 73 00000100:00100000:1.0:1787381414.028412:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+6:2351:x1874205047009664:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787381414.028438:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f561500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+6:2351:x1874205047009664:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 26us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381414.028444:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 73 00000100:00100000:1.0:1787381414.028463:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047010048 00000100:00100000:1.0:1787381414.028466:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047010048 00000100:00100000:1.0:1787381414.028486:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047009920 00000100:00100000:1.0:1787381414.028489:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047009920 00000100:00100000:1.0:1787381414.028506:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 36 00000100:00100000:1.0:1787381414.028511:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f562680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2351:x1874205047010048:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787381414.028535:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f562680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2351:x1874205047010048:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 23us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381414.028542:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 36 00000100:00100000:1.0:1787381414.028554:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 37 00000100:00100000:1.0:1787381414.028570:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f560000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2351:x1874205047009920:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787381414.028593:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f560000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2351:x1874205047009920:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 33us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381414.028599:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 37 00000100:00080000:1.0:1787381414.028619:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787381414.028622:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787381414.028625:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787381414.028806:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047009536 00000100:00100000:3.0:1787381414.028816:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047009536 00000100:00100000:3.0:1787381414.028856:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 223 00000100:00100000:3.0:1787381414.028863:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2351:x1874205047009536:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381414.028899:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2351:x1874205047009536:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 36us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381414.028906:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 223 00010000:00010000:3.0:1787381414.800074:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381415.820870:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381416.844279:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787381417.294647:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787381417.294674:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166fb27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065917184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787381417.294749:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381417.295034:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065917184 00000100:00100000:3.0:1787381417.295043:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065917184 00000100:00100000:3.0:1787381417.295101:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787381417.295110:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f6b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065917184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787381417.295147:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787381417.295195:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f6b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065917184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381417.295202:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1787381417.295284:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a166fb27800 x1874205065917184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787381417.295306:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166fb27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065917184:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787381417.295367:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787381417.296171:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1874205065917568:0@lo:400:kworker.0 00000100:00100000:0.0:1787381417.296213:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381417.296310:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787381417.296317:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874205065917440:0@lo:400:kworker.0 00000100:00100000:0.0:1787381417.296353:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381417.296474:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd19486c-5291-4823-bb9c-f3a73416a496:3309:1874205065917312:0@lo:400:kworker.0 00000100:00100000:2.0:1787381417.296507:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381417.296551:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065917824:0@lo:400:kworker.0 00000100:00100000:0.0:1787381417.296569:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065917312 00000100:00100000:2.0:1787381417.296574:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381417.296575:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065917312 00000100:00100000:2.0:1787381417.296591:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787381417.296610:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1874205065917696:0@lo:400:kworker.0 00000100:00100000:0.0:1787381417.296611:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787381417.296617:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+19:3309:x1874205065917312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381417.296633:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381417.296653:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+19:3309:x1874205065917312:12345-0@lo:400:kworker.0 Request processed in 35us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381417.296656:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f921880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd19486c-5291-4823-bb9c-f3a73416a496:3309:1874205065917312:0@lo:400:kworker.0 00000100:00100000:0.0:1787381417.296659:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787381417.296680:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065917568 00000100:00100000:2.0:1787381417.296684:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065917568 00000100:00100000:2.0:1787381417.296715:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065917440 00000100:00080000:0.0:1787381417.296716:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787381417.296718:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065917440 00000100:00100000:2.0:1787381417.296730:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065917696 00000100:00100000:2.0:1787381417.296733:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065917696 00000100:00100000:2.0:1787381417.296762:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787381417.296767:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f923b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874205065917568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381417.296805:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f923b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874205065917568:12345-0@lo:400:kworker.0 Request processed in 37us (591us total) trans 0 rc 0/0 00000100:00080000:0.0:1787381417.296807:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787381417.296812:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787381417.296824:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787381417.296830:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874205065917440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381417.296857:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874205065917440:12345-0@lo:400:kworker.0 Request processed in 27us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381417.296862:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787381417.296874:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787381417.296880:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f6bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874205065917696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381417.296920:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f6bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874205065917696:12345-0@lo:400:kworker.0 Request processed in 40us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381417.296926:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787381417.296954:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f920a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874205065917440:0@lo:400:kworker.0 00000100:00100000:2.0:1787381417.296964:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f923100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1874205065917568:0@lo:400:kworker.0 00000100:00100000:0.0:1787381417.297136:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1874205065917696:0@lo:400:kworker.0 00000100:00100000:1.0:1787381417.297292:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065917824 00000100:00100000:1.0:1787381417.297298:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065917824 00000100:00100000:1.0:1787381417.297347:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787381417.297403:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f6b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065917824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381417.297451:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f6b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065917824:12345-0@lo:400:kworker.0 Request processed in 98us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381417.297457:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1787381417.297502:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787381417.297577:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a166f921c00 x1874205065917824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787381433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787381417.297587:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065917824:0@lo:400:kworker.0 00000100:00100000:2.0:1787381417.807678:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f562300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065917952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787381417.807749:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381417.807882:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065917952 00000100:00100000:1.0:1787381417.807892:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065917952 00000100:00100000:1.0:1787381417.807947:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787381417.807957:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f6baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065917952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787381417.807994:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787381417.808070:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f6baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065917952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381417.808083:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1787381417.810569:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167f562300 x1874205065917952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787381417.810598:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f562300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065917952:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787381417.872872:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381418.892994:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787381419.145684:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381419.145773:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381419.145794:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047010176 00000100:00100000:2.0:1787381419.145804:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047010176 00000100:00100000:2.0:1787381419.145861:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 225 00000100:00100000:2.0:1787381419.145871:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2352:x1874205047010176:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787381419.145942:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2352:x1874205047010176:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 72us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381419.145949:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 225 00000100:00100000:1.0:1787381419.147439:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381419.147479:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381419.147593:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047010688 00000100:00100000:2.0:1787381419.147601:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047010688 00000100:00100000:2.0:1787381419.147660:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00100000:2.0:1787381419.147670:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f560700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2352:x1874205047010688:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787381419.147748:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f560700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2352:x1874205047010688:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 79us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381419.147755:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00080000:2.0:1787381419.147774:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787381419.150170:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381419.150294:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047010560 00000100:00100000:1.0:1787381419.150302:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047010560 00000100:00100000:1.0:1787381419.150372:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 40 00000100:00100000:1.0:1787381419.150381:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f563800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2352:x1874205047010560:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787381419.150448:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f563800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2352:x1874205047010560:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 68us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381419.150463:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 40 00000100:00080000:1.0:1787381419.150488:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787381419.153435:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047010432 00000100:00100000:3.0:1787381419.153449:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047010432 00000100:00100000:3.0:1787381419.154140:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047010304 00000100:00100000:3.0:1787381419.154145:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047010304 00000100:00100000:3.0:1787381419.154169:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 77 00000100:00100000:3.0:1787381419.154178:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f561f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2352:x1874205047010432:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787381419.154291:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 78 00000100:00100000:1.0:1787381419.154300:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+6:2352:x1874205047010304:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787381419.154368:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f563480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+6:2352:x1874205047010304:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 69us (6887us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381419.154375:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 78 00000100:00080000:1.0:1787381419.154400:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787381419.154669:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f561f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2352:x1874205047010432:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 491us (8894us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381419.154676:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 77 00010000:00010000:1.0:1787381419.918060:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381420.943453:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381421.965196:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787381422.413296:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166fb24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065918080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787381422.413418:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381422.414415:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065918080 00000100:00100000:3.0:1787381422.414442:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065918080 00000100:00100000:3.0:1787381422.414531:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787381422.414544:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a807480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065918080:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787381422.414590:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1787381422.414595:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787381422.414681:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a807480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065918080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (1262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381422.414688:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787381422.414709:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065918208:0@lo:400:kworker.0 00000100:00100000:1.0:1787381422.414761:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787381422.414861:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a166fb24a80 x1874205065918080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381422.414883:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166fb24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065918080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787381422.415301:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065918208 00000100:00100000:3.0:1787381422.415308:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065918208 00000100:00100000:3.0:1787381422.415352:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1787381422.415361:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+19:3308:x1874205065918208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381422.421470:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a806300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874205065918336:0@lo:400:kworker.0 00000100:00100000:2.0:1787381422.421594:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381422.422878:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787381422.422885:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1874205065918592:0@lo:400:kworker.0 00000100:00100000:2.0:1787381422.422898:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a528380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065918720:0@lo:400:kworker.0 00000100:00100000:0.0:1787381422.422984:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381422.423035:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787381422.423056:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a528e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1874205065918464:0@lo:400:kworker.0 00000100:00100000:0.0:1787381422.423084:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381422.423484:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381422.423556:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065918720 00000100:00100000:0.0:1787381422.423568:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065918720 00000100:00080000:2.0:1787381422.423664:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787381422.423669:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787381422.423683:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a52a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065918720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381422.423757:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065918336 00000100:00100000:1.0:1787381422.423762:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065918336 00000100:00100000:1.0:1787381422.423797:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065918592 00000100:00100000:1.0:1787381422.423801:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065918592 00000100:00100000:1.0:1787381422.423822:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065918464 00000100:00100000:1.0:1787381422.423825:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065918464 00000100:00100000:1.0:1787381422.423841:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787381422.423847:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a33ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874205065918336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381422.423925:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a52a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065918720:12345-0@lo:400:kworker.0 Request processed in 244us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381422.423934:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787381422.423989:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065918208:0@lo:400:kworker.0 00000100:00100000:1.0:1787381422.424032:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a33ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874205065918336:12345-0@lo:400:kworker.0 Request processed in 183us (2436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381422.424040:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787381422.424059:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787381422.424065:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874205065918592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381422.424126:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874205065918592:12345-0@lo:400:kworker.0 Request processed in 61us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381422.424133:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787381422.424146:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787381422.424151:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874205065918464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381422.424192:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f920e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874205065918464:12345-0@lo:400:kworker.0 Request processed in 41us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381422.424199:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787381422.424230:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+19:3308:x1874205065918208:12345-0@lo:400:kworker.0 Request processed in 8866us (9464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381422.424242:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00080000:1.0:1787381422.424376:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787381422.424529:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a528e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1874205065918464:0@lo:400:kworker.0 00000100:00100000:2.0:1787381422.424543:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1874205065918592:0@lo:400:kworker.0 00010000:00080000:0.0:1787381422.431573:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a528380 x1874205065918720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787381438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381422.431594:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a528380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065918720:0@lo:400:kworker.0 00000100:00100000:0.0:1787381422.431618:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a806300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874205065918336:0@lo:400:kworker.0 00000100:00100000:2.0:1787381422.929188:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787381422.929210:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065918848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787381422.929285:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381422.929607:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065918848 00000100:00100000:3.0:1787381422.929616:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065918848 00000100:00100000:3.0:1787381422.929842:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787381422.929853:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065918848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787381422.929890:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787381422.929952:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065918848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381422.929960:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1787381422.930048:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a529180 x1874205065918848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381422.930067:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065918848:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787381422.992237:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381424.018742:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787381424.269866:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381424.269902:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381424.269939:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381424.269962:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381424.269985:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381424.270039:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047011200 00000100:00100000:2.0:1787381424.270049:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047011200 00000100:00100000:2.0:1787381424.270102:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047011328 00000100:00100000:2.0:1787381424.270105:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047011328 00000100:00100000:2.0:1787381424.270129:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:2.0:1787381424.270138:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674fd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2348:x1874205047011200:12345-192.168.203.22@tcp:9:kworker.0 00000100:00100000:3.0:1787381424.270255:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047010944 00000100:00100000:3.0:1787381424.270260:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047010944 00000100:00100000:3.0:1787381424.270289:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047011072 00000100:00100000:3.0:1787381424.270291:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047011072 00000100:00100000:3.0:1787381424.270311:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 82 00000100:00100000:3.0:1787381424.270317:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+6:2351:x1874205047010944:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381424.270393:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a529500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+6:2351:x1874205047010944:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 75us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381424.270401:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 82 00000100:00100000:3.0:1787381424.270415:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 83 00000100:00100000:3.0:1787381424.270421:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2351:x1874205047011072:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381424.270440:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2351:x1874205047011072:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 20us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381424.270446:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 83 00000100:00100000:3.0:1787381424.270581:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:3.0:1787381424.270588:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a52a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2348:x1874205047011328:12345-192.168.203.22@tcp:9:kworker.0 00000020:00000080:3.0:1787381424.270604:0:6587:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbdc38ada7ea0fa03 00000100:00080000:3.0:1787381424.270614:0:6587:0:(import.c:65:import_set_state_nolock()) ffff9a1675362800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787381424.270645:0:6587:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787381424.270966:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a52a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+2:2348:x1874205047011328:12345-192.168.203.22@tcp:9:kworker.0 Request processed in 377us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381424.270973:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 15 00010000:00010000:3.0:1787381424.270994:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787381424.271049:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787381424.271053:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787381424.271055:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1787381424.273614:0:6590:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbdc38ada7ea0f9fc 00000100:00080000:3.0:1787381424.273631:0:6590:0:(import.c:65:import_set_state_nolock()) ffff9a1675365800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787381424.274804:0:6590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1787381424.275267:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787381424.277373:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047010816 00000100:00100000:0.0:1787381424.277389:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047010816 00000100:00100000:0.0:1787381424.277450:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 227 00000100:00100000:0.0:1787381424.277459:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2351:x1874205047010816:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381424.278074:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674fd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+2:2348:x1874205047011200:12345-192.168.203.22@tcp:9:kworker.0 Request processed in 7933us (8130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381424.278085:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:0.0:1787381424.286479:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2351:x1874205047010816:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 9007us (16609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381424.286506:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 227 00000001:00100000:3.0:1787381424.550253:0:7481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 76f8c15f-81f9-4e6f-a311-d4cb5f530dfa 00000020:00000080:3.0:1787381424.550262:0:7481:0:(genops.c:906:class_export_put()) final put ffff9a1675361800/76f8c15f-81f9-4e6f-a311-d4cb5f530dfa 00000020:00000080:0.0:1787381424.550351:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a1675361800/76f8c15f-81f9-4e6f-a311-d4cb5f530dfa for lustre-OST0001 00000020:00000080:0.0:1787381424.550408:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a1675362800 for lustre-OST0001 00010000:00010000:3.0:1787381425.037477:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787381425.580218:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 76f8c15f-81f9-4e6f-a311-d4cb5f530dfa 00000020:00000080:1.0:1787381425.580227:0:6614:0:(genops.c:906:class_export_put()) final put ffff9a1675364000/76f8c15f-81f9-4e6f-a311-d4cb5f530dfa 00000020:00000080:2.0:1787381425.581450:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9a1675364000/76f8c15f-81f9-4e6f-a311-d4cb5f530dfa for lustre-OST0000 00000020:00000080:2.0:1787381425.581515:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a1675365800 for lustre-OST0000 00010000:00010000:2.0:1787381426.060366:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787381426.287536:0:10861:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787381427.086197:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787381427.533079:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a52b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1874205065919232:0@lo:400:kworker.0 00000100:00100000:2.0:1787381427.533145:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381427.533241:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787381427.533248:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a52b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065919360:0@lo:400:kworker.0 00000100:00100000:2.0:1787381427.533275:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381427.533327:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065919232 00000100:00100000:2.0:1787381427.533335:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065919232 00000100:00100000:2.0:1787381427.533386:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787381427.533396:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a52b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874205065919232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381427.533448:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a52b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874205065919232:12345-0@lo:400:kworker.0 Request processed in 54us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381427.533454:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787381427.533487:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065919360 00000100:00100000:2.0:1787381427.533490:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065919360 00000100:00100000:2.0:1787381427.533529:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787381427.533535:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a52ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065919360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381427.533563:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a52ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065919360:12345-0@lo:400:kworker.0 Request processed in 29us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381427.533569:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1787381427.533582:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787381427.533586:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787381427.533616:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a52b800 x1874205065919360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787381443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787381427.533630:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a52b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065919360:0@lo:400:kworker.0 00000100:00100000:2.0:1787381427.533660:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a52b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1874205065919232:0@lo:400:kworker.0 00000100:00100000:1.0:1787381427.534112:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a529f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd19486c-5291-4823-bb9c-f3a73416a496:3310:1874205065918976:0@lo:400:kworker.0 00000100:00100000:1.0:1787381427.534157:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381427.534191:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a529880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1874205065919488:0@lo:400:kworker.0 00000100:00100000:1.0:1787381427.534218:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381427.534235:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787381427.534241:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a528700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874205065919104:0@lo:400:kworker.0 00000100:00100000:1.0:1787381427.534303:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381427.534335:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a528a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065919616:0@lo:400:kworker.0 00000100:00100000:1.0:1787381427.534359:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381427.534390:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065919616 00000100:00100000:1.0:1787381427.534395:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065919616 00000100:00100000:1.0:1787381427.534435:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787381427.534442:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f563100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065919616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381427.534502:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f563100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065919616:12345-0@lo:400:kworker.0 Request processed in 60us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381427.534509:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1787381427.534540:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a528a80 x1874205065919616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787381443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381427.534551:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a528a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065919616:0@lo:400:kworker.0 00000100:00100000:3.0:1787381427.534657:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065919488 00000100:00100000:3.0:1787381427.534662:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065919488 00000100:00100000:3.0:1787381427.534693:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065919104 00000100:00100000:3.0:1787381427.534697:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065919104 00000100:00100000:3.0:1787381427.534727:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787381427.534736:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f561880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874205065919488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787381427.534779:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f561880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874205065919488:12345-0@lo:400:kworker.0 Request processed in 44us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381427.534786:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787381427.534800:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787381427.534806:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f560a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874205065919104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787381427.534832:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f560a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874205065919104:12345-0@lo:400:kworker.0 Request processed in 27us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381427.534838:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787381427.535047:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a528700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874205065919104:0@lo:400:kworker.0 00000100:00100000:3.0:1787381427.535058:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a529880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1874205065919488:0@lo:400:kworker.0 00000100:00100000:2.0:1787381427.535258:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065918976 00000100:00100000:2.0:1787381427.535264:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065918976 00000100:00100000:2.0:1787381427.535313:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787381427.535320:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+19:3310:x1874205065918976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381427.535364:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+19:3310:x1874205065918976:12345-0@lo:400:kworker.0 Request processed in 44us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381427.535369:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00080000:3.0:1787381427.541100:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787381427.541112:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787381427.541200:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a529f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd19486c-5291-4823-bb9c-f3a73416a496:3310:1874205065918976:0@lo:400:kworker.0 00000100:00100000:3.0:1787381427.542632:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a529f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065919744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787381427.542722:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381427.543220:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065919744 00000100:00100000:2.0:1787381427.543228:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065919744 00000100:00100000:2.0:1787381427.543554:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787381427.543568:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fb27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065919744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787381427.543604:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787381427.543730:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fb27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065919744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 166us (1015us total) trans 0 rc 0/0 00010000:00080000:0.0:1787381427.543783:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a529f80 x1874205065919744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381427.543803:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a529f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065919744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787381427.552683:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787381428.046212:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787381428.046233:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a52b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065919872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787381428.046308:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381428.046370:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065919872 00000100:00100000:1.0:1787381428.046377:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065919872 00000100:00100000:1.0:1787381428.046419:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787381428.046427:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f562d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065919872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787381428.046459:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787381428.046512:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f562d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065919872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381428.046520:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1787381428.046555:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a52b480 x1874205065919872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381444 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381428.046574:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a52b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065919872:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787381428.108294:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381429.135634:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787381429.386161:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381429.386227:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047011456 00000100:00100000:3.0:1787381429.386234:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381429.386242:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047011456 00000100:00100000:3.0:1787381429.386284:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381429.386312:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047011712 00000100:00100000:1.0:1787381429.386314:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 229 00000100:00100000:3.0:1787381429.386318:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047011712 00000100:00100000:1.0:1787381429.386329:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2349:x1874205047011456:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381429.386367:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047011584 00000100:00100000:3.0:1787381429.386372:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047011584 00000100:00100000:3.0:1787381429.386398:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 87 00000100:00100000:3.0:1787381429.386407:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fb26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2349:x1874205047011712:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787381429.386422:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2349:x1874205047011456:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 96us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381429.386439:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 229 00000100:00100000:3.0:1787381429.386539:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fb26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2349:x1874205047011712:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 133us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381429.386547:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 87 00000100:00100000:3.0:1787381429.386573:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 88 00000100:00100000:3.0:1787381429.386580:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fb25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+6:2349:x1874205047011584:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381429.386611:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fb25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+6:2349:x1874205047011584:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 31us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381429.386629:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 88 00000100:00080000:3.0:1787381429.386656:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:2.0:1787381429.829259:0:11010:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffd8c7b7040 00000020:00000080:2.0:1787381429.829275:0:11010:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:2.0:1787381429.829279:0:11010:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:2.0:1787381429.829289:0:11010:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd8c7b92d0 20000000:00000080:2.0:1787381429.829296:0:11010:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a167f5ecc00 uarg=0000000000000000 20000000:01000000:2.0:1787381429.829336:0:11010:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787381429.829342:0:11010:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787381429.829347:0:11010:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787381429.830506:0:11011:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1787381429.830816:0:11010:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787381429.840472:0:11010:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787381429.840587:0:11010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a1681733a00/0xbdc38ada7ea0fa0a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381429.840609:0:11010:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a1647eb0200/0xbdc38ada7ea0f9af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953632 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381429.840618:0:11010:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a1681732000/0xbdc38ada7ea0f9bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f9b6 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381429.840626:0:11010:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a1681733c00/0xbdc38ada7ea0f9cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f9c4 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381429.840644:0:11010:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a1647eb0000/0xbdc38ada7ea0f9d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0f9d2 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381429.840653:0:11010:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a1541388800/0xbdc38ada7ea0f9ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95366a expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381429.840661:0:11010:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a1681733a00/0xbdc38ada7ea0fa0a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381429.840701:0:11010:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a1541388800/0xbdc38ada7ea0f9ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95366a expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381429.840715:0:11010:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a1541388800/0xbdc38ada7ea0f9ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95366a expref: 12 pid: 5784 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381429.840728:0:11010:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a52b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11010:1874205065920000:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787381429.840828:0:11010:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a1647eb0000/0xbdc38ada7ea0f9d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbdc38ada7ea0f9d2 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381429.840855:0:11010:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a1647eb0000/0xbdc38ada7ea0f9d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f9d2 expref: 18 pid: 5783 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381429.840865:0:11010:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a529c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11010:1874205065920128:0@lo:104: 00000100:00100000:2.0:1787381429.840906:0:11010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787381429.840962:0:11010:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a1681733c00/0xbdc38ada7ea0f9cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbdc38ada7ea0f9c4 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381429.840971:0:11010:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a1681733c00/0xbdc38ada7ea0f9cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f9c4 expref: 18 pid: 5783 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381429.840978:0:11010:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a52aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11010:1874205065920256:0@lo:104: 00000100:00100000:1.0:1787381429.841054:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065920128 00000100:00100000:1.0:1787381429.841063:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065920128 00000100:00100000:1.0:1787381429.841112:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787381429.841123:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a52bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd19486c-5291-4823-bb9c-f3a73416a496+3:11010:x1874205065920128:12345-0@lo:104: 00010000:00010000:1.0:1787381429.841136:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1c00/0xbdc38ada7ea0f9d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f9d9 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381429.841185:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787381429.841192:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a52bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd19486c-5291-4823-bb9c-f3a73416a496+3:11010:x1874205065920128:12345-0@lo:104: Request processed in 71us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381429.841198:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:1.0:1787381429.841222:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787381429.841228:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1c00/0xbdc38ada7ea0f9d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f9d9 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381429.841235:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb1c00 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:1.0:1787381429.841239:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1c00/0xbdc38ada7ea0f9d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbdc38ada7ea0f9d9 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381429.841247:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1c00/0xbdc38ada7ea0f9d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbdc38ada7ea0f9d9 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787381429.841255:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1c00/0xbdc38ada7ea0f9d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbdc38ada7ea0f9d9 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787381429.841261:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787381429.841286:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1c00/0xbdc38ada7ea0f9d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f9d9 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381429.841299:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787381429.841321:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1c00/0xbdc38ada7ea0f9d2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f9d9 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381429.841327:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1c00/0xbdc38ada7ea0f9d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f9d9 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381429.841339:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381429.841341:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381429.841342:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787381429.841354:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f561c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd19486c-5291-4823-bb9c-f3a73416a496:3310:1874205065920384:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787381429.841385:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381429.841426:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065920384 00000100:00100000:1.0:1787381429.841431:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065920384 00010000:00010000:1.0:1787381429.841448:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a1647eb0000/0xbdc38ada7ea0f9d9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f9d2 expref: 19 pid: 5783 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381429.841486:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787381429.841493:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166d05d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd19486c-5291-4823-bb9c-f3a73416a496+19:3310:x1874205065920384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787381429.841502:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381429.841507:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a1647eb0000/0xbdc38ada7ea0f9d9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f9d2 expref: 19 pid: 5783 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381429.841516:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a1647eb0000/0xbdc38ada7ea0f9d9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f9d2 expref: 19 pid: 5783 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381429.841531:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381429.841559:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166d05d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd19486c-5291-4823-bb9c-f3a73416a496+19:3310:x1874205065920384:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381429.841577:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787381429.841641:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f561c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd19486c-5291-4823-bb9c-f3a73416a496:3310:1874205065920384:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787381429.842983:0:11010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381429.843041:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065920256 00000100:00100000:1.0:1787381429.843048:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065920256 00000100:00100000:1.0:1787381429.843096:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787381429.843103:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a52b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd19486c-5291-4823-bb9c-f3a73416a496+3:11010:x1874205065920256:12345-0@lo:104: 00010000:00010000:1.0:1787381429.843115:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1a00/0xbdc38ada7ea0f9c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f9cb expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381429.843606:0:11010:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a1681732000/0xbdc38ada7ea0f9bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbdc38ada7ea0f9b6 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381429.843619:0:11010:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a1681732000/0xbdc38ada7ea0f9bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f9b6 expref: 18 pid: 5783 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381429.843631:0:11010:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a529f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11010:1874205065920512:0@lo:104: 00010000:00010000:1.0:1787381429.845517:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787381429.845531:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a52b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd19486c-5291-4823-bb9c-f3a73416a496+3:11010:x1874205065920256:12345-0@lo:104: Request processed in 2426us (2547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381429.845540:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787381429.845554:0:11010:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787381429.845605:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787381429.845611:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1a00/0xbdc38ada7ea0f9c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f9cb expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381429.845618:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb1a00 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:0.0:1787381429.845622:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1a00/0xbdc38ada7ea0f9c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbdc38ada7ea0f9cb expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381429.845630:0:11010:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a1647eb0200/0xbdc38ada7ea0f9af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953632 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381429.845631:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1a00/0xbdc38ada7ea0f9c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbdc38ada7ea0f9cb expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787381429.845638:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1a00/0xbdc38ada7ea0f9c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbdc38ada7ea0f9cb expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787381429.845641:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787381429.845657:0:11010:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a1647eb0200/0xbdc38ada7ea0f9af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953632 expref: 12 pid: 5783 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381429.845667:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1a00/0xbdc38ada7ea0f9c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f9cb expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381429.845672:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787381429.845675:0:11010:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a528700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11010:1874205065920640:192.168.203.22@tcp:104: 00010000:00010000:0.0:1787381429.845688:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1a00/0xbdc38ada7ea0f9c4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f9cb expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381429.845711:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1a00/0xbdc38ada7ea0f9c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f9cb expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381429.845722:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381429.845723:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381429.845724:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787381429.845735:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd19486c-5291-4823-bb9c-f3a73416a496:3311:1874205065920768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787381429.845754:0:11010:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16583d63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787381429.845764:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787381429.845780:0:11010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1647eb0000/0xbdc38ada7ea0f9d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbdc38ada7ea0f9d2 expref: 18 pid: 5783 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381429.845794:0:11010:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a529c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11010:1874205065920128:0@lo:104: 00000100:00100000:2.0:1787381429.845806:0:11010:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a52aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11010:1874205065920256:0@lo:104: 00000100:00100000:1.0:1787381429.845812:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065920512 00000100:00100000:1.0:1787381429.845819:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065920512 00000100:00100000:1.0:1787381429.845901:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787381429.845912:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a529880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd19486c-5291-4823-bb9c-f3a73416a496+3:11010:x1874205065920512:12345-0@lo:104: 00010000:00010000:1.0:1787381429.845921:0:5774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea0f9b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f9bd expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381429.845970:0:5774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787381429.845975:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a529880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cd19486c-5291-4823-bb9c-f3a73416a496+3:11010:x1874205065920512:12345-0@lo:104: Request processed in 67us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381429.845981:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787381429.846076:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065920768 00000100:00100000:1.0:1787381429.846254:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065920768 00010000:00010000:1.0:1787381429.846273:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a1681733c00/0xbdc38ada7ea0f9cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f9c4 expref: 18 pid: 5783 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381429.846309:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787381429.846315:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f920380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd19486c-5291-4823-bb9c-f3a73416a496+18:3311:x1874205065920768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787381429.846327:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381429.846333:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a1681733c00/0xbdc38ada7ea0f9cb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f9c4 expref: 18 pid: 5783 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381429.846499:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a1681733c00/0xbdc38ada7ea0f9cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f9c4 expref: 18 pid: 5783 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381429.846515:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1681733c00/0xbdc38ada7ea0f9cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbdc38ada7ea0f9c4 expref: 18 pid: 5783 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381429.846533:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381429.846567:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f920380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd19486c-5291-4823-bb9c-f3a73416a496+17:3311:x1874205065920768:12345-0@lo:103:ldlm_bl.0 Request processed in 252us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381429.846573:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787381429.846607:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f921180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd19486c-5291-4823-bb9c-f3a73416a496:3311:1874205065920768:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787381429.846704:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787381429.846709:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea0f9b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0f9bd expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381429.846717:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541389400 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:0.0:1787381429.846721:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea0f9b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbdc38ada7ea0f9bd expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381429.846729:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea0f9b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbdc38ada7ea0f9bd expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787381429.846735:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea0f9b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbdc38ada7ea0f9bd expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787381429.846741:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787381429.846759:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea0f9b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f9bd expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381429.846765:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787381429.846788:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea0f9b6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f9bd expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381429.846818:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea0f9b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0f9bd expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381429.846831:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381429.846833:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381429.846834:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787381429.846841:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787381429.846851:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f922680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd19486c-5291-4823-bb9c-f3a73416a496:3309:1874205065920896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787381429.846881:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381429.846942:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065920896 00000100:00100000:1.0:1787381429.846946:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065920896 00010000:00010000:1.0:1787381429.846961:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a1681732000/0xbdc38ada7ea0f9bd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f9b6 expref: 17 pid: 5783 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381429.846985:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787381429.846991:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f921500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd19486c-5291-4823-bb9c-f3a73416a496+17:3309:x1874205065920896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787381429.847028:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381429.847033:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a1681732000/0xbdc38ada7ea0f9bd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f9b6 expref: 17 pid: 5783 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381429.847052:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a1681732000/0xbdc38ada7ea0f9bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbdc38ada7ea0f9b6 expref: 17 pid: 5783 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381429.847064:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787381429.847201:0:11010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1681732000/0xbdc38ada7ea0f9bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbdc38ada7ea0f9b6 expref: 17 pid: 5783 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381429.847212:0:11010:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a529f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11010:1874205065920512:0@lo:104: 00000100:00100000:1.0:1787381429.847759:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f921500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd19486c-5291-4823-bb9c-f3a73416a496+16:3309:x1874205065920896:12345-0@lo:103:ldlm_bl.0 Request processed in 767us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381429.847769:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787381429.847818:0:11010:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a52b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11010:1874205065920000:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787381429.847856:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f922680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd19486c-5291-4823-bb9c-f3a73416a496:3309:1874205065920896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787381429.852265:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381429.852328:0:11010:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a528700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11010:1874205065920640:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787381429.852380:0:11010:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a1681733a00/0xbdc38ada7ea0fa0a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381429.852478:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047011968 00000100:00100000:1.0:1787381429.852493:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047011968 00010000:00010000:1.0:1787381429.852538:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a1647eb0200/0xbdc38ada7ea0f9af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953632 expref: 13 pid: 5783 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381429.852619:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 28 00000100:00100000:1.0:1787381429.852630:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fb27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2349:x1874205047011968:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787381429.852646:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381429.852652:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a1647eb0200/0xbdc38ada7ea0f9af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953632 expref: 13 pid: 5783 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381429.852663:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a1647eb0200/0xbdc38ada7ea0f9af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953632 expref: 13 pid: 5783 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381429.852680:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1647eb0200/0xbdc38ada7ea0f9af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953632 expref: 13 pid: 5783 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381429.852694:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381429.852756:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fb27b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c93c8548-229c-4d2f-8357-13904b6fe0fb+12:2349:x1874205047011968:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 128us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381429.852764:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 28 00000100:00100000:3.0:1787381429.855591:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381429.856533:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047011840 00000100:00100000:1.0:1787381429.856548:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047011840 00010000:00010000:2.0:1787381429.856662:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a1541388800/0xbdc38ada7ea0f9ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95366a expref: 12 pid: 5784 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381429.856701:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 29 00000100:00100000:2.0:1787381429.856711:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fb26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c93c8548-229c-4d2f-8357-13904b6fe0fb+12:2350:x1874205047011840:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787381429.856728:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381429.856734:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a1541388800/0xbdc38ada7ea0f9ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95366a expref: 12 pid: 5784 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381429.856747:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a1541388800/0xbdc38ada7ea0f9ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95366a expref: 12 pid: 5784 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381429.856802:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1541388800/0xbdc38ada7ea0f9ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95366a expref: 12 pid: 5784 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381429.856821:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a1681733a00/0xbdc38ada7ea0fa0a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381429.856830:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1681733a00/0xbdc38ada7ea0fa0a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381429.856850:0:5777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a1681733a00/0xbdc38ada7ea0fa0a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381429.856857:0:5777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a1681733a00/0xbdc38ada7ea0fa0a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381429.856864:0:5777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a1681733a00/0xbdc38ada7ea0fa0a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381429.856872:0:5777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a1681733a00/0xbdc38ada7ea0fa0a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381429.856878:0:5777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681733a00 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:2.0:1787381429.856884:0:5777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a1681733a00/0xbdc38ada7ea0fa0a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381429.856892:0:5777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a1681733a00/0xbdc38ada7ea0fa0a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381429.856932:0:5777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a1681733a00/0xbdc38ada7ea0fa0a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381429.857505:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787381429.857622:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fb26a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c93c8548-229c-4d2f-8357-13904b6fe0fb+11:2350:x1874205047011840:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 910us (2043us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381429.857632:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 29 00010000:00010000:3.0:1787381429.857740:0:11010:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a1681733a00/0xbdc38ada7ea0fa0a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381429.857750:0:11010:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a1681733a00/0xbdc38ada7ea0fa0a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381429.857756:0:11010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1681733a00/0xbdc38ada7ea0fa0a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11010 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381430.156268:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787381430.987138:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381430.987303:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047012096 00000100:00100000:0.0:1787381430.987315:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047012096 00000100:00100000:0.0:1787381430.987393:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 230 00000100:00100000:0.0:1787381430.987405:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+11:5567:x1874205047012096:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787381430.987428:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381430.987467:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1640030a00/0xbdc38ada7ea0fa11 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc01952459a953694 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381430.987505:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1640030a00/0xbdc38ada7ea0fa11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953694 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381430.987519:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1640030a00/0xbdc38ada7ea0fa11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953694 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381430.987530:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1640030a00, rc 0) 00000100:00100000:0.0:1787381430.987606:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+12:5567:x1874205047012096:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 Request processed in 204us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381430.987630:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 230 00000100:00100000:3.0:1787381430.992775:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381430.992894:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047012224 00000100:00100000:2.0:1787381430.992908:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047012224 00000100:00100000:2.0:1787381430.992981:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 231 00000100:00100000:2.0:1787381430.992992:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+12:5567:x1874205047012224:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787381430.993379:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+12:5567:x1874205047012224:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 Request processed in 388us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381430.993389:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 231 00000100:00100000:2.0:1787381430.995734:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381430.995966:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047012352 00000100:00100000:0.0:1787381430.995979:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047012352 00000100:00100000:0.0:1787381430.996078:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 232 00000100:00100000:0.0:1787381430.996090:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+12:5567:x1874205047012352:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787381430.996370:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+12:5567:x1874205047012352:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 Request processed in 280us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381430.996381:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 232 00000100:00100000:2.0:1787381431.014889:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381431.020727:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047012480 00000100:00100000:3.0:1787381431.020749:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047012480 00000100:00100000:3.0:1787381431.020829:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 233 00000100:00100000:3.0:1787381431.020841:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+12:5567:x1874205047012480:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787381431.020863:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381431.020888:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1647eb1e00/0xbdc38ada7ea0fa18 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc01952459a95369b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381431.020927:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1647eb1e00/0xbdc38ada7ea0fa18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95369b expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381431.020940:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1647eb1e00/0xbdc38ada7ea0fa18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95369b expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381431.020952:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb1e00, rc 0) 00000100:00100000:3.0:1787381431.021066:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:5567:x1874205047012480:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 Request processed in 227us (6191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381431.021075:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 233 00000100:00100000:0.0:1787381431.033510:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381431.033599:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047012608 00000100:00100000:2.0:1787381431.033621:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047012608 00000100:00100000:2.0:1787381431.033690:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 234 00000100:00100000:2.0:1787381431.033702:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:5567:x1874205047012608:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787381431.034139:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:5567:x1874205047012608:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 Request processed in 439us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381431.034148:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 234 00000100:00100000:2.0:1787381431.037838:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381431.037947:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047012736 00000100:00100000:0.0:1787381431.037960:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047012736 00000100:00100000:0.0:1787381431.038067:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 235 00000100:00100000:0.0:1787381431.038087:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:5567:x1874205047012736:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787381431.038813:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:5567:x1874205047012736:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 Request processed in 732us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381431.038822:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 235 00010000:00010000:0.0:1787381431.180906:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787381431.759620:0:5787:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787381431.759627:0:5787:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a16436a3000 from 7 10000000:01000000:0.0:1787381431.759632:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787381431.759738:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1640031e00/0xbdc38ada7ea0fa1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381431.759751:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a1640031e00/0xbdc38ada7ea0fa1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381431.759761:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a1640031e00/0xbdc38ada7ea0fa1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381431.759793:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f922680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065921024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787381431.759857:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381431.762597:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f5b5180 going to sleep for 11 seconds 00000100:00100000:1.0:1787381431.762876:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065921024 00000100:00100000:1.0:1787381431.762895:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065921024 00000100:00100000:1.0:1787381431.763135:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787381431.763148:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+16:5787:x1874205065921024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787381431.763176:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381431.763212:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1541389800/0xbdc38ada7ea0fa26 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0fa1f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381431.763250:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1541389800/0xbdc38ada7ea0fa26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0fa1f expref: 17 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381431.763264:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1541389800/0xbdc38ada7ea0fa26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0fa1f expref: 17 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381431.763276:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541389800, rc 0) 00000100:00100000:1.0:1787381431.763376:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+17:5787:x1874205065921024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 231us (3518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381431.763384:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1787381431.763600:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f922680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065921024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787381431.763626:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a1640031e00/0xbdc38ada7ea0fa1f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0fa26 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381431.763639:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a1640031e00/0xbdc38ada7ea0fa1f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0fa26 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381431.763717:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f922680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065921152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787381431.763771:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381431.764677:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065921152 00000100:00100000:0.0:1787381431.764690:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f5b5180 going to sleep for 11 seconds 00000100:00100000:2.0:1787381431.764691:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065921152 00000100:00100000:2.0:1787381431.764764:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787381431.764777:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+17:5787:x1874205065921152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787381431.765758:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+17:5787:x1874205065921152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 979us (1980us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381431.765771:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1787381431.766076:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f922680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065921152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787381431.766146:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f922680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065921280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787381431.766219:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381431.767677:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f5b5180 going to sleep for 11 seconds 00000100:00100000:1.0:1787381431.772198:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065921280 00000100:00100000:1.0:1787381431.772213:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065921280 00000100:00100000:1.0:1787381431.772284:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787381431.772295:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+17:5787:x1874205065921280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787381431.772666:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+17:5787:x1874205065921280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 372us (6446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381431.772674:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787381431.772836:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f922680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065921280:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787381431.776523:0:11067:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787381431.778974:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787381431.779062:0:5787:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787381431.779074:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1640031e00/0xbdc38ada7ea0fa1f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0fa26 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381431.779087:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a1640031e00/0xbdc38ada7ea0fa1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0fa26 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787381431.779099:0:5787:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787381431.779101:0:5787:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a1646496800 from 7 10000000:01000000:2.0:1787381431.779104:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787381431.779143:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1681733000/0xbdc38ada7ea0fa2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381431.779152:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a1681733000/0xbdc38ada7ea0fa2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381431.779162:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a1681733000/0xbdc38ada7ea0fa2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381431.779186:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a528700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065921408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787381431.779248:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381431.779329:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1675018840 going to sleep for 11 seconds 00000100:00100000:1.0:1787381431.785981:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065921408 00000100:00100000:1.0:1787381431.785996:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065921408 00000100:00100000:1.0:1787381431.786158:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787381431.786168:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+17:5787:x1874205065921408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787381431.786184:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381431.786200:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1541388600/0xbdc38ada7ea0fa34 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0fa2d expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381431.786225:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1541388600/0xbdc38ada7ea0fa34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0fa2d expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381431.786235:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1541388600/0xbdc38ada7ea0fa34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0fa2d expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381431.786244:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541388600, rc 0) 00000100:00100000:1.0:1787381431.786317:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+18:5787:x1874205065921408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (7068us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381431.786323:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787381431.786489:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a528700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065921408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787381431.786518:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a1681733000/0xbdc38ada7ea0fa2d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0fa34 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381431.786527:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a1681733000/0xbdc38ada7ea0fa2d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0fa34 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381431.786591:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a528700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065921536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787381431.786625:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381431.790812:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1675018840 going to sleep for 11 seconds 00000100:00100000:0.0:1787381431.796740:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065921536 00000100:00100000:0.0:1787381431.796756:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065921536 00000100:00100000:0.0:1787381431.796821:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787381431.796832:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+18:5787:x1874205065921536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787381431.797152:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+18:5787:x1874205065921536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 321us (10525us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381431.797160:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787381431.797296:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a528700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065921536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787381431.797349:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f922680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065921664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787381431.797410:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381431.797448:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f5b56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787381431.797460:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065921664 00000100:00100000:0.0:1787381431.797464:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065921664 00000100:00100000:0.0:1787381431.797482:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787381431.797488:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1650553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+18:5787:x1874205065921664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787381431.797626:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1650553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+18:5787:x1874205065921664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381431.797633:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787381431.797674:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f922680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065921664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787381431.798288:0:11068:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787381431.798337:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787381431.798357:0:5787:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787381431.798367:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1681733000/0xbdc38ada7ea0fa2d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0fa34 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381431.798378:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a1681733000/0xbdc38ada7ea0fa2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0fa34 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787381431.798389:0:5787:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787381431.798391:0:5787:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a16659a7000 from 7 10000000:01000000:0.0:1787381431.798394:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787381431.798417:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1640030600/0xbdc38ada7ea0fa3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381431.798425:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a1640030600/0xbdc38ada7ea0fa3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381431.798455:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a1640030600/0xbdc38ada7ea0fa3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381431.798472:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f922680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065921792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787381431.798506:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381431.798521:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f5b5600 going to sleep for 11 seconds 00000100:00100000:0.0:1787381431.798535:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065921792 00000100:00100000:0.0:1787381431.798538:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065921792 00000100:00100000:0.0:1787381431.798557:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787381431.798563:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1650552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+18:5787:x1874205065921792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787381431.798573:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381431.798584:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1640030000/0xbdc38ada7ea0fa42 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0fa3b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381431.798603:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1640030000/0xbdc38ada7ea0fa42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0fa3b expref: 19 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381431.798613:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1640030000/0xbdc38ada7ea0fa42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0fa3b expref: 19 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381431.798622:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1640030000, rc 0) 00000100:00100000:0.0:1787381431.798650:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1650552850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+19:5787:x1874205065921792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381431.798656:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787381431.798686:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f922680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065921792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787381431.798697:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a1640030600/0xbdc38ada7ea0fa3b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0fa42 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381431.798711:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a1640030600/0xbdc38ada7ea0fa3b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0fa42 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381431.798746:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f922680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065921920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787381431.798769:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381431.798781:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f5b5600 going to sleep for 11 seconds 00000100:00100000:0.0:1787381431.798791:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065921920 00000100:00100000:0.0:1787381431.798794:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065921920 00000100:00100000:0.0:1787381431.798809:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787381431.798814:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+19:5787:x1874205065921920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787381431.798986:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+19:5787:x1874205065921920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 171us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381431.798993:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787381431.799040:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f922680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065921920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787381431.799061:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f922680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065922048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787381431.799096:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381431.799108:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f5370c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787381431.799120:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065922048 00000100:00100000:0.0:1787381431.799123:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065922048 00000100:00100000:0.0:1787381431.799139:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787381431.799144:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+19:5787:x1874205065922048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787381431.799261:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+19:5787:x1874205065922048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381431.799267:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787381431.799310:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f922680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065922048:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787381431.799969:0:11069:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787381431.800027:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787381431.800041:0:5787:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787381431.800049:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1640030600/0xbdc38ada7ea0fa3b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0fa42 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381431.800059:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a1640030600/0xbdc38ada7ea0fa3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0fa42 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381432.209289:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787381432.653924:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a52b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065922176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787381432.653990:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381432.654300:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f562a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1874205065922560:0@lo:400:kworker.0 00000100:00100000:1.0:1787381432.654336:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381432.654359:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787381432.654365:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f562680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1874205065922688:0@lo:400:kworker.0 00000100:00100000:1.0:1787381432.654386:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381432.654419:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065922176 00000100:00100000:1.0:1787381432.654427:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065922176 00000100:00100000:1.0:1787381432.654495:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787381432.654505:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a529f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065922176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787381432.654555:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787381432.654592:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a529f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065922176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381432.654598:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787381432.654620:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f563b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874205065922432:0@lo:400:kworker.0 00000100:00100000:1.0:1787381432.654641:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381432.654657:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787381432.654662:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f561c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd19486c-5291-4823-bb9c-f3a73416a496:3311:1874205065922304:0@lo:400:kworker.0 00000100:00100000:1.0:1787381432.654700:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381432.654721:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f560000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065922816:0@lo:400:kworker.0 00000100:00100000:1.0:1787381432.654742:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381432.654769:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065922560 00000100:00100000:1.0:1787381432.654773:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065922560 00000100:00100000:1.0:1787381432.654800:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065922688 00000100:00100000:1.0:1787381432.654803:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065922688 00000100:00100000:1.0:1787381432.654817:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065922432 00000100:00100000:1.0:1787381432.654819:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065922432 00000100:00100000:1.0:1787381432.654831:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787381432.654837:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874205065922560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381432.654872:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874205065922560:12345-0@lo:400:kworker.0 Request processed in 35us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381432.654878:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787381432.654890:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787381432.654896:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f563800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874205065922688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381432.654922:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f563800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874205065922688:12345-0@lo:400:kworker.0 Request processed in 26us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381432.654936:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787381432.654949:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787381432.654954:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f562300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874205065922432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381432.654986:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f562300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874205065922432:12345-0@lo:400:kworker.0 Request processed in 32us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381432.654992:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1787381432.655038:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787381432.655043:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787381432.655058:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065922304 00000100:00100000:1.0:1787381432.655062:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065922304 00000100:00100000:1.0:1787381432.655100:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787381432.655108:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+19:3311:x1874205065922304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381432.655138:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+19:3311:x1874205065922304:12345-0@lo:400:kworker.0 Request processed in 32us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381432.655145:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787381432.655172:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065922816 00000100:00100000:1.0:1787381432.655175:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065922816 00000100:00100000:1.0:1787381432.655204:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787381432.655211:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065922816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381432.655240:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065922816:12345-0@lo:400:kworker.0 Request processed in 29us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381432.655246:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1787381432.655268:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787381432.655296:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f562680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1874205065922688:0@lo:400:kworker.0 00000100:00100000:1.0:1787381432.655307:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f562a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1874205065922560:0@lo:400:kworker.0 00000100:00100000:1.0:1787381432.655347:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f561c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd19486c-5291-4823-bb9c-f3a73416a496:3311:1874205065922304:0@lo:400:kworker.0 00010000:00080000:1.0:1787381432.655358:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167f560000 x1874205065922816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787381448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381432.655368:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f560000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065922816:0@lo:400:kworker.0 00000100:00100000:1.0:1787381432.655378:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f563b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874205065922432:0@lo:400:kworker.0 00010000:00080000:1.0:1787381432.655406:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a52b800 x1874205065922176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381448 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381432.655422:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a52b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065922176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787381433.164229:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065922944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787381433.164297:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381433.164370:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065922944 00000100:00100000:1.0:1787381433.164377:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065922944 00000100:00100000:1.0:1787381433.164419:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787381433.164439:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065922944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787381433.164477:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787381433.164519:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065922944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381433.164526:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1787381433.164562:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a1674ed4e00 x1874205065922944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381449 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381433.164578:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065922944:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787381433.228392:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787381433.972695:0:11209:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787381434.252377:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787381434.508821:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381434.508862:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381434.508890:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381434.508968:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047013120 00000100:00100000:1.0:1787381434.508968:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047012992 00000100:00100000:3.0:1787381434.508979:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047013120 00000100:00100000:1.0:1787381434.508979:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047012992 00000100:00100000:2.0:1787381434.509051:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047012864 00000100:00100000:2.0:1787381434.509056:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047012864 00000100:00100000:2.0:1787381434.509113:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 246 00000100:00100000:2.0:1787381434.509123:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2352:x1874205047012864:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787381434.509185:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2352:x1874205047012864:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 63us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381434.509193:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 246 00000100:00100000:3.0:1787381434.509531:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 92 00000100:00100000:3.0:1787381434.509538:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2352:x1874205047013120:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381434.509578:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2352:x1874205047013120:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 40us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381434.509583:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 92 00000100:00080000:0.0:1787381434.510634:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787381434.512100:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 93 00000100:00100000:1.0:1787381434.512115:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+6:2351:x1874205047012992:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787381434.512318:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+6:2351:x1874205047012992:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 91us (3338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381434.512328:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 93 00010000:00010000:3.0:1787381435.280779:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381436.301031:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787381437.231876:0:11309:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 02:50:34 (1787381434) === 00010000:00010000:1.0:1787381437.324344:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787381437.376551:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381437.377532:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381437.377730:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047013376 00000100:00100000:0.0:1787381437.377740:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047013376 00000100:00100000:0.0:1787381437.377801:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:0.0:1787381437.377813:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f2157c09-10df-40cb-8228-ad4822122c97+6:9654:x1874205047013376:12345-192.168.203.22@tcp:700:mkdir.0 00000100:00100000:0.0:1787381437.377894:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f2157c09-10df-40cb-8228-ad4822122c97+6:9654:x1874205047013376:12345-192.168.203.22@tcp:700:mkdir.0 Request processed in 83us (1354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381437.377902:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00080000:0.0:1787381437.377925:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787381437.378090:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047013248 00000100:00100000:3.0:1787381437.378122:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047013248 00000100:00100000:3.0:1787381437.378198:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:3.0:1787381437.378208:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+6:2350:x1874205047013248:12345-192.168.203.22@tcp:41:mkdir.0 00000004:00000024:3.0:1787381437.378258:0:8469:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1787381437.378338:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+6:2350:x1874205047013248:12345-192.168.203.22@tcp:41:mkdir.0 Request processed in 132us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381437.378345:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:0.0:1787381437.388552:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381437.388672:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047013632 00000100:00100000:2.0:1787381437.388683:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047013632 00000100:00100000:2.0:1787381437.388739:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:2.0:1787381437.388752:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+6:9654:x1874205047013632:12345-192.168.203.22@tcp:36:mkdir.0 00010000:00010000:2.0:1787381437.388818:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381437.388850:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a168216c000/0xbdc38ada7ea0f92a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95361d expref: 6 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.389483:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1643052500) 00010000:00010000:2.0:1787381437.389497:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787381437.389789:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732400/0xbdc38ada7ea0fa49 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.389804:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732400/0xbdc38ada7ea0fa49 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.389814:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732400/0xbdc38ada7ea0fa49 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.389875:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733c00/0xbdc38ada7ea0fa50 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.389883:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733c00/0xbdc38ada7ea0fa50 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.390484:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733c00/0xbdc38ada7ea0fa50 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787381437.395504:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787381437.395521:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732400/0xbdc38ada7ea0fa49 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.395532:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732400/0xbdc38ada7ea0fa49 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.395541:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732400/0xbdc38ada7ea0fa49 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.395547:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681732400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381437.395558:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732400/0xbdc38ada7ea0fa49 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.395567:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732400/0xbdc38ada7ea0fa49 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.395584:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1650b8f300) 00010000:00010000:2.0:1787381437.395587:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381437.395591:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732400/0xbdc38ada7ea0fa49 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.395597:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732400/0xbdc38ada7ea0fa49 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787381437.395619:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000521e67ae reply state 0000000002ffb6f5 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733c00/0xbdc38ada7ea0fa50 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381437.395628:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787381437.395737:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f922300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+7:9654:x1874205047013632:12345-192.168.203.22@tcp:36:mkdir.0 Request processed in 6986us (7193us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787381437.395747:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 15 00010000:00010000:2.0:1787381437.398062:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733c00/0xbdc38ada7ea0fa50 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.398076:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733c00/0xbdc38ada7ea0fa50 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.398082:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733c00/0xbdc38ada7ea0fa50 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.398087:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681733c00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381437.398091:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733c00/0xbdc38ada7ea0fa50 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.398108:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733c00/0xbdc38ada7ea0fa50 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.398124:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a1650b8f200) 00010000:00010000:2.0:1787381437.398126:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381437.398140:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733c00/0xbdc38ada7ea0fa50 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.398147:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733c00/0xbdc38ada7ea0fa50 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381437.412556:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381437.412844:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047013760 00000100:00100000:3.0:1787381437.412854:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047013760 00000100:00100000:3.0:1787381437.412916:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:3.0:1787381437.412925:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+6:9655:x1874205047013760:12345-192.168.203.22@tcp:101:chmod.0 00010000:00010000:3.0:1787381437.412946:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381437.412968:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea0fa57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9536a2 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.413150:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea0fa5e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.413165:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea0fa5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.413176:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea0fa5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787381437.413238:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787381437.413242:0:8469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787381437.413287:0:8469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea0fa5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.413314:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea0fa57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536a2 expref: 8 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.413346:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea0fa5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536a2 expref: 7 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.413355:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1643052300) 00010000:00010000:3.0:1787381437.413358:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787381437.413360:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb1400, rc 0) 00000100:00100000:3.0:1787381437.413434:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+7:9655:x1874205047013760:12345-192.168.203.22@tcp:101:chmod.0 Request processed in 510us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381437.413441:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:3.0:1787381437.419491:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381437.419576:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047014016 00000100:00100000:2.0:1787381437.419587:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047014016 00000100:00100000:2.0:1787381437.419713:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:2.0:1787381437.419724:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fb24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+7:9655:x1874205047014016:12345-192.168.203.22@tcp:36:chmod.0 00010000:00010000:2.0:1787381437.419776:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381437.419802:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea0fa5e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536a2 expref: 7 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.419820:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1643052300) 00010000:00010000:2.0:1787381437.419832:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787381437.419859:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733c00/0xbdc38ada7ea0fa65 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.419871:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733c00/0xbdc38ada7ea0fa65 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.419881:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733c00/0xbdc38ada7ea0fa65 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787381437.420255:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000067fced8f reply state 00000000410628de transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733c00/0xbdc38ada7ea0fa65 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381437.420264:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787381437.420279:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787381437.420367:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fb24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+8:9655:x1874205047014016:12345-192.168.203.22@tcp:36:chmod.0 Request processed in 644us (884us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787381437.420376:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 17 00010000:00010000:3.0:1787381437.422123:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733c00/0xbdc38ada7ea0fa65 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.422136:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733c00/0xbdc38ada7ea0fa65 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.422144:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733c00/0xbdc38ada7ea0fa65 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.422150:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681733c00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381437.422154:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733c00/0xbdc38ada7ea0fa65 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.422162:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733c00/0xbdc38ada7ea0fa65 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.422177:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1650b8f200) 00010000:00010000:3.0:1787381437.422179:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787381437.422195:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733c00/0xbdc38ada7ea0fa65 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.422201:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733c00/0xbdc38ada7ea0fa65 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381437.451705:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381437.451821:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047014144 00000100:00100000:1.0:1787381437.451832:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047014144 00000100:00100000:1.0:1787381437.451896:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:1.0:1787381437.451906:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fb25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+7:9656:x1874205047014144:12345-192.168.203.22@tcp:101:chown.0 00010000:00010000:1.0:1787381437.451932:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381437.451957:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea0fa6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9536a9 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.452121:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea0fa73 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.452135:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea0fa73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.452147:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea0fa73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787381437.452652:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787381437.452669:0:8469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787381437.452715:0:8469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea0fa73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.452746:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea0fa6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536a9 expref: 9 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.452765:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea0fa73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536a9 expref: 8 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.452774:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1659f89900) 00010000:00010000:1.0:1787381437.452777:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787381437.452780:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541389600, rc 0) 00000100:00100000:1.0:1787381437.452884:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fb25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+8:9656:x1874205047014144:12345-192.168.203.22@tcp:101:chown.0 Request processed in 979us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381437.452891:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:1.0:1787381437.459044:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381437.459294:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047014272 00000100:00100000:2.0:1787381437.459305:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047014272 00000100:00100000:2.0:1787381437.459364:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:2.0:1787381437.459374:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+8:9656:x1874205047014272:12345-192.168.203.22@tcp:101:chown.0 00010000:00010000:2.0:1787381437.459394:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381437.459430:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732400/0xbdc38ada7ea0fa7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9536b0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.459494:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea0fa81 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.459508:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea0fa81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.459520:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea0fa81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.459536:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733a00/0xbdc38ada7ea0fa88 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.459543:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733a00/0xbdc38ada7ea0fa88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.459564:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733a00/0xbdc38ada7ea0fa88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.459681:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733c00/0xbdc38ada7ea0fa8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.459689:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733c00/0xbdc38ada7ea0fa8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.459697:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733c00/0xbdc38ada7ea0fa8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787381437.459738:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787381437.459742:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787381437.460050:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733c00/0xbdc38ada7ea0fa8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.460064:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea0fa81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.460071:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea0fa81 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.460077:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea0fa81 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.460083:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681732000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381437.460087:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea0fa81 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.460094:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea0fa81 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.460114:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1659f89900) 00010000:00010000:2.0:1787381437.460117:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381437.460122:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea0fa81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.460128:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea0fa81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.460148:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733a00/0xbdc38ada7ea0fa88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.460154:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733a00/0xbdc38ada7ea0fa88 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.460159:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733a00/0xbdc38ada7ea0fa88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.460163:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681733a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381437.460166:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733a00/0xbdc38ada7ea0fa88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.460171:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733a00/0xbdc38ada7ea0fa88 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.460178:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a1650b8f300) 00010000:00010000:2.0:1787381437.460180:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381437.460183:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733a00/0xbdc38ada7ea0fa88 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.460188:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733a00/0xbdc38ada7ea0fa88 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.460237:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732400/0xbdc38ada7ea0fa7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536b0 expref: 10 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.460252:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733c00/0xbdc38ada7ea0fa8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536b0 expref: 9 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.460259:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a1650b8f500) 00010000:00010000:2.0:1787381437.460262:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787381437.460264:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1681733c00, rc 0) 00000100:00100000:2.0:1787381437.460333:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+9:9656:x1874205047014272:12345-192.168.203.22@tcp:101:chown.0 Request processed in 960us (1297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381437.460342:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:0.0:1787381437.464834:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381437.464926:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047014528 00000100:00100000:2.0:1787381437.464935:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047014528 00000100:00100000:2.0:1787381437.465508:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:2.0:1787381437.465520:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f920700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+9:9656:x1874205047014528:12345-192.168.203.22@tcp:36:chown.0 00010000:00010000:2.0:1787381437.465576:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381437.465604:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733c00/0xbdc38ada7ea0fa8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536b0 expref: 9 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.465625:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a1650b8f500) 00010000:00010000:2.0:1787381437.465637:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787381437.465661:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732e00/0xbdc38ada7ea0fa96 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.465673:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732e00/0xbdc38ada7ea0fa96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.465696:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732e00/0xbdc38ada7ea0fa96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787381437.550232:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1787381437.550352:0:5791:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007af100b1 reply state 00000000e0b0ee83 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732e00/0xbdc38ada7ea0fa96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381437.550365:0:5791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787381437.550814:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:3.0:1787381437.550958:0:5791:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1787381437.551037:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f920700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+7:9656:x1874205047014528:12345-192.168.203.22@tcp:36:chown.0 Request processed in 85515us (86207us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787381437.551047:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 20 00010000:00010000:2.0:1787381437.551391:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732e00/0xbdc38ada7ea0fa96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.551410:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732e00/0xbdc38ada7ea0fa96 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.551418:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732e00/0xbdc38ada7ea0fa96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.551425:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681732e00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381437.551430:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732e00/0xbdc38ada7ea0fa96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.551437:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732e00/0xbdc38ada7ea0fa96 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.551452:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a1650b8fb00) 00010000:00010000:2.0:1787381437.551455:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787381437.551459:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732e00/0xbdc38ada7ea0fa96 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.551465:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732e00/0xbdc38ada7ea0fa96 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381437.574542:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381437.574643:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047014656 00000100:00100000:1.0:1787381437.574654:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047014656 00000100:00100000:1.0:1787381437.574722:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:1.0:1787381437.574733:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f921c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+6:9657:x1874205047014656:12345-192.168.203.22@tcp:101:touch.500 00010000:00010000:1.0:1787381437.574758:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381437.574777:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389400/0xbdc38ada7ea0fa9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9536b7 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787381437.581656:0:5790:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 6827us 00010000:00010000:1.0:1787381437.604580:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0faa4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.604601:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0faa4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.604621:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0faa4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.604636:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0faab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.604644:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0faab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.604651:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0faab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.605149:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea0fab2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.605158:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea0fab2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.605166:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea0fab2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787381437.605305:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787381437.605310:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787381437.605411:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea0fab2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.605424:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0faa4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.605431:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0faa4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.605447:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0faa4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.605452:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381437.605457:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0faa4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.605467:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0faa4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.605479:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1659f89900) 00010000:00010000:1.0:1787381437.605482:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381437.605486:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0faa4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.605492:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0faa4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.605503:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0faab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.605509:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0faab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.605514:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0faab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.605519:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388c00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381437.605522:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0faab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.605537:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0faab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.605545:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a1659f89100) 00010000:00010000:1.0:1787381437.605548:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381437.605551:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0faab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.605555:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0faab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.605593:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389400/0xbdc38ada7ea0fa9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536b7 expref: 8 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.605606:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea0fab2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536b7 expref: 7 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.605613:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a1659f89a00) 00010000:00010000:1.0:1787381437.605615:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787381437.605618:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541389000, rc 0) 00000100:00100000:1.0:1787381437.605743:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f921c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+7:9657:x1874205047014656:12345-192.168.203.22@tcp:101:touch.500 Request processed in 31010us (31223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381437.605752:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:3.0:1787381437.613336:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381437.613459:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047014912 00000100:00100000:1.0:1787381437.613469:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047014912 00000100:00100000:1.0:1787381437.613516:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:1.0:1787381437.613523:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fb24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+7:9657:x1874205047014912:12345-192.168.203.22@tcp:101:touch.500 00010000:00010000:1.0:1787381437.613571:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381437.613589:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fab9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9536be expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.613889:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fac0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.613903:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fac0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.613913:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fac0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.613966:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0fac7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.613973:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0fac7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.613978:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0fac7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787381437.614743:0:8469:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1787381437.614979:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0face lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.614990:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0face lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.614999:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0face lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.615077:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fac0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.615084:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fac0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.615090:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fac0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.615097:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541389e00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381437.615101:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fac0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.615108:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fac0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.615119:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a1659f89a00) 00010000:00010000:1.0:1787381437.615121:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381437.615126:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fac0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.615132:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fac0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787381437.615143:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ecfb2324 reply state 000000004e2b4dc9 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0fac7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381437.615152:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787381437.615182:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fab9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536be expref: 10 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.615207:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0face lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536be expref: 9 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.615214:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a1659f89600) 00010000:00010000:1.0:1787381437.615216:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787381437.615218:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541389c00, rc 0) 00000100:00100000:1.0:1787381437.615286:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fb24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+10:9657:x1874205047014912:12345-192.168.203.22@tcp:101:touch.500 Request processed in 1762us (1970us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787381437.615295:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 22 00010000:00010000:3.0:1787381437.622042:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0fac7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.622059:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0fac7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.622074:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0fac7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.622087:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541389a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381437.622092:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0fac7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.622099:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0fac7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.622135:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x48a8de3 (ffff9a1659f89b00) 00010000:00010000:3.0:1787381437.622138:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381437.622142:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0fac7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.622148:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0fac7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381437.624768:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381437.625137:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047015168 00000100:00100000:2.0:1787381437.625148:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047015168 00000100:00100000:2.0:1787381437.625229:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:2.0:1787381437.625239:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fb26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+9:9657:x1874205047015168:12345-192.168.203.22@tcp:36:touch.500 00010000:00010000:2.0:1787381437.625296:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381437.625321:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0face lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536be expref: 9 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.625337:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a1659f89600) 00010000:00010000:2.0:1787381437.625347:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787381437.625389:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732e00/0xbdc38ada7ea0fadc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.625411:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732e00/0xbdc38ada7ea0fadc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.625421:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732e00/0xbdc38ada7ea0fadc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787381437.625546:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000096854d96 reply state 0000000022a55d56 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732e00/0xbdc38ada7ea0fadc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381437.625566:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787381437.625663:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fb26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+10:9657:x1874205047015168:12345-192.168.203.22@tcp:36:touch.500 Request processed in 424us (902us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787381437.625671:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 23 00010000:00010000:1.0:1787381437.629957:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732e00/0xbdc38ada7ea0fadc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381437.629972:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00010000:00010000:1.0:1787381437.629977:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732e00/0xbdc38ada7ea0fadc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.629984:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732e00/0xbdc38ada7ea0fadc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.629990:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681732e00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381437.629994:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732e00/0xbdc38ada7ea0fadc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.630036:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732e00/0xbdc38ada7ea0fadc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.630053:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a1650b8fb00) 00010000:00010000:1.0:1787381437.630056:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381437.630061:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732e00/0xbdc38ada7ea0fadc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381437.630196:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047015296 00000100:00100000:3.0:1787381437.630206:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047015296 00000100:00100000:3.0:1787381437.630257:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 24 00000100:00100000:3.0:1787381437.630266:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+10:9657:x1874205047015296:12345-192.168.203.22@tcp:101:touch.500 00010000:00010000:3.0:1787381437.630287:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381437.630303:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea0fae3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9536c5 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.630353:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea0fae3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536c5 expref: 11 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.630366:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea0fae3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536c5 expref: 11 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.630384:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a1650b8fb00) 00010000:00010000:3.0:1787381437.630387:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787381437.630389:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb1800, rc 0) 00000100:00100000:3.0:1787381437.630461:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+11:9657:x1874205047015296:12345-192.168.203.22@tcp:101:touch.500 Request processed in 195us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381437.630479:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 24 00010000:00010000:1.0:1787381437.630758:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732e00/0xbdc38ada7ea0fadc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381437.639335:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381437.639423:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047015424 00000100:00100000:1.0:1787381437.639433:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047015424 00000100:00100000:1.0:1787381437.639490:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:1.0:1787381437.639498:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f920a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2348:x1874205047015424:12345-192.168.203.22@tcp:8:touch.500 00010000:00080000:1.0:1787381437.639531:0:7779:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from f2157c09-10df-40cb-8228-ad4822122c97@192.168.203.22@tcp t0 exp 0000000000000000 cur 295 last 0 00000020:00000080:1.0:1787381437.639576:0:7779:0:(genops.c:1406:class_connect()) connect: client f2157c09-10df-40cb-8228-ad4822122c97, cookie 0xbdc38ada7ea0faea 00002000:00100000:1.0:1787381437.639590:0:7779:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f2157c09-10df-40cb-8228-ad4822122c97/ffff9a167f6e9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113673 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787381437.639611:0:7779:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787381437.639806:0:7779:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787381437.639862:0:7779:0:(import.c:65:import_set_state_nolock()) ffff9a167f6ee000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787381437.640048:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f920a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2157c09-10df-40cb-8228-ad4822122c97+6:2348:x1874205047015424:12345-192.168.203.22@tcp:8:touch.500 Request processed in 549us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381437.640057:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:0.0:1787381437.645759:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381437.645907:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047015552 00000100:00100000:1.0:1787381437.645917:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047015552 00000100:00100000:1.0:1787381437.646129:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:1.0:1787381437.646140:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f921880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2157c09-10df-40cb-8228-ad4822122c97+6:0:x1874205047015552:12345-192.168.203.22@tcp:2:touch.500 00000100:00080000:0.0:1787381437.647279:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1787381437.708532:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:1.0:1787381437.708548:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f2157c09-10df-40cb-8228-ad4822122c97 00000100:00100000:0.0:1787381437.708743:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f921880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2157c09-10df-40cb-8228-ad4822122c97+5:0:x1874205047015552:12345-192.168.203.22@tcp:2:touch.500 Request processed in 62601us (62989us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787381437.708755:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:2.0:1787381437.713588:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381437.713702:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047015808 00000100:00100000:3.0:1787381437.713712:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047015808 00000100:00100000:3.0:1787381437.713823:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:3.0:1787381437.713834:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a52aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+10:9657:x1874205047015808:12345-192.168.203.22@tcp:35:touch.500 00000100:00100000:2.0:1787381437.714822:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a52aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+11:9657:x1874205047015808:12345-192.168.203.22@tcp:35:touch.500 Request processed in 980us (1235us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787381437.714834:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:1.0:1787381437.740823:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381437.740911:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047015936 00000100:00100000:2.0:1787381437.740936:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047015936 00000100:00100000:2.0:1787381437.740992:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:2.0:1787381437.741040:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+11:9658:x1874205047015936:12345-192.168.203.22@tcp:101:rm.0 00010000:00010000:2.0:1787381437.741065:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381437.741086:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732400/0xbdc38ada7ea0faf1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9536cc expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.741155:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733a00/0xbdc38ada7ea0faf8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.741168:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733a00/0xbdc38ada7ea0faf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.741180:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733a00/0xbdc38ada7ea0faf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787381437.741251:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787381437.741255:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787381437.741353:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733a00/0xbdc38ada7ea0faf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.741406:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732400/0xbdc38ada7ea0faf1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536cc expref: 13 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.741427:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733a00/0xbdc38ada7ea0faf8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536cc expref: 12 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.741437:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a1659f89a00) 00010000:00010000:2.0:1787381437.741439:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787381437.741443:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1681733a00, rc 0) 00000100:00100000:2.0:1787381437.742300:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+12:9658:x1874205047015936:12345-192.168.203.22@tcp:101:rm.0 Request processed in 1293us (1481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381437.742311:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:0.0:1787381437.749165:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381437.750444:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047016192 00000100:00100000:3.0:1787381437.750459:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047016192 00000100:00100000:3.0:1787381437.750571:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 26 00000100:00100000:3.0:1787381437.750583:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167ab40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+12:9658:x1874205047016192:12345-192.168.203.22@tcp:101:rm.0 00010000:00010000:3.0:1787381437.750605:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381437.750627:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea0faff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9536d3 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787381437.750747:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787381437.750922:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea0faff lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536d3 expref: 14 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.750937:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1659f89900) 00010000:00010000:3.0:1787381437.750940:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787381437.750945:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea0faff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536d3 expref: 14 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.750959:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb0600, rc 0) 00000100:00100000:3.0:1787381437.751043:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167ab40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+13:9658:x1874205047016192:12345-192.168.203.22@tcp:101:rm.0 Request processed in 463us (1887us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1787381437.751051:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 26 00000100:00100000:0.0:1787381437.767965:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381437.768463:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047016320 00000100:00100000:1.0:1787381437.768475:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047016320 00000100:00100000:1.0:1787381437.768551:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 3 00000100:00100000:1.0:1787381437.768678:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167ab43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+13:9658:x1874205047016320:12345-192.168.203.22@tcp:37:rm.0 00000100:00100000:2.0:1787381437.776651:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787381437.776673:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166fb25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd19486c-5291-4823-bb9c-f3a73416a496:3309:1874205065923200:0@lo:400:kworker.0 00000100:00100000:2.0:1787381437.776746:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381437.776795:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a529c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065923072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787381437.776820:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381437.776830:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065923200 00000100:00100000:3.0:1787381437.776839:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065923200 00000100:00100000:2.0:1787381437.776842:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1874205065923712:0@lo:400:kworker.0 00000100:00100000:2.0:1787381437.776869:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381437.776888:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787381437.776895:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787381437.776895:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166fb27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065923584:0@lo:400:kworker.0 00000100:00100000:3.0:1787381437.776910:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+19:3309:x1874205065923200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381437.776920:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381437.776949:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065923072 00000100:00100000:2.0:1787381437.776953:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065923072 00000100:00100000:3.0:1787381437.776974:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+19:3309:x1874205065923200:12345-0@lo:400:kworker.0 Request processed in 66us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381437.776983:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787381437.776997:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787381437.777047:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a528a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065923072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787381437.777065:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787381437.777077:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065923584 00000100:00100000:3.0:1787381437.777082:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065923584 00000100:00100000:2.0:1787381437.777095:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a528a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1874205065923072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381437.777103:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1787381437.777122:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787381437.777123:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787381437.777133:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065923584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381437.777153:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166fb25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd19486c-5291-4823-bb9c-f3a73416a496:3309:1874205065923200:0@lo:400:kworker.0 00010000:00080000:2.0:1787381437.777168:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a529c00 x1874205065923072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381453 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787381437.777176:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065923584:12345-0@lo:400:kworker.0 Request processed in 42us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381437.777186:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787381437.777191:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a529c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065923072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787381437.777218:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065923712 00000100:00100000:3.0:1787381437.777223:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065923712 00010000:00080000:2.0:1787381437.777239:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a166fb27800 x1874205065923584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787381453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787381437.777249:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166fb27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065923584:0@lo:400:kworker.0 00000100:00100000:3.0:1787381437.777264:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00080000:2.0:1787381437.777269:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787381437.777274:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a52a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874205065923712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381437.777485:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166fb24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874205065923328:0@lo:400:kworker.0 00000100:00100000:1.0:1787381437.777513:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381437.777539:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065923840:0@lo:400:kworker.0 00000100:00100000:1.0:1787381437.777557:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381437.777573:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787381437.777577:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166fb24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1874205065923456:0@lo:400:kworker.0 00000100:00100000:1.0:1787381437.777593:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381437.777648:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065923840 00000100:00100000:2.0:1787381437.777651:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065923840 00000100:00100000:2.0:1787381437.777687:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787381437.777693:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f563b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065923840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787381437.777713:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065923328 00000100:00100000:3.0:1787381437.777719:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065923328 00000100:00100000:2.0:1787381437.777732:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f563b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065923840:12345-0@lo:400:kworker.0 Request processed in 38us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381437.777739:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787381437.777748:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065923456 00000100:00100000:3.0:1787381437.777757:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065923456 00010000:00080000:2.0:1787381437.777767:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a33d880 x1874205065923840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787381453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787381437.777778:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065923840:0@lo:400:kworker.0 00000100:00100000:3.0:1787381437.777786:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787381437.777800:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874205065923328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381437.777801:0:5792:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1787381437.777809:0:5792:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1787381437.777862:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874205065923328:12345-0@lo:400:kworker.0 Request processed in 64us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381437.777870:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787381437.777895:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787381437.777899:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166fb24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874205065923328:0@lo:400:kworker.0 00000100:00100000:3.0:1787381437.777906:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874205065923456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381437.777933:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a52a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874205065923712:12345-0@lo:400:kworker.0 Request processed in 662us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381437.777940:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787381437.777969:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1874205065923712:0@lo:400:kworker.0 00000100:00100000:3.0:1787381437.777973:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f560000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874205065923456:12345-0@lo:400:kworker.0 Request processed in 65us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381437.777985:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787381437.777992:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166fb24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1874205065923456:0@lo:400:kworker.0 00000100:00080000:1.0:1787381437.779447:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787381437.779455:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787381437.785767:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167ab43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+13:9658:x1874205047016320:12345-192.168.203.22@tcp:37:rm.0 Request processed in 17084us (17804us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381437.785789:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 3 00000100:00100000:0.0:1787381437.805552:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381437.805989:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047016576 00000100:00100000:2.0:1787381437.806000:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047016576 00000100:00100000:2.0:1787381437.806109:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:2.0:1787381437.806119:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166d3ba450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+13:9658:x1874205047016576:12345-192.168.203.22@tcp:35:rm.0 00000100:00100000:2.0:1787381437.806369:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166d3ba450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+14:9658:x1874205047016576:12345-192.168.203.22@tcp:35:rm.0 Request processed in 249us (825us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787381437.806377:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:2.0:1787381437.810689:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381437.811543:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047016832 00000100:00100000:3.0:1787381437.811554:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047016832 00000100:00100000:3.0:1787381437.811668:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 27 00000100:00100000:3.0:1787381437.811679:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a52aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+14:9658:x1874205047016832:12345-192.168.203.22@tcp:101:rm.0 00010000:00010000:3.0:1787381437.811705:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381437.811726:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea0fb0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9536da expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.811847:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0c00/0xbdc38ada7ea0fb14 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.811861:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0c00/0xbdc38ada7ea0fb14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.811873:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0c00/0xbdc38ada7ea0fb14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787381437.811883:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787381437.812087:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea0fb0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536da expref: 17 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.812624:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0c00/0xbdc38ada7ea0fb14 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536da expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.812647:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a1659f89a00) 00010000:00010000:3.0:1787381437.812650:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787381437.812654:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb0c00, rc 0) 00000100:00100000:3.0:1787381437.812718:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a52aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+16:9658:x1874205047016832:12345-192.168.203.22@tcp:101:rm.0 Request processed in 1041us (2040us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787381437.812724:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 27 00000100:00100000:1.0:1787381437.816762:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381437.816881:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047016960 00000100:00100000:3.0:1787381437.816891:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047016960 00000100:00100000:3.0:1787381437.816957:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 28 00000100:00100000:3.0:1787381437.816968:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f561c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+16:9658:x1874205047016960:12345-192.168.203.22@tcp:41:rm.0 00000004:00000024:3.0:1787381437.817071:0:5792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1787381437.817166:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f561c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+16:9658:x1874205047016960:12345-192.168.203.22@tcp:41:rm.0 Request processed in 200us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381437.817174:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 28 00000100:00100000:1.0:1787381437.823333:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381437.823435:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047017088 00000100:00100000:2.0:1787381437.823445:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047017088 00000100:00100000:2.0:1787381437.823506:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 29 00000100:00100000:2.0:1787381437.823515:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f562a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+16:9658:x1874205047017088:12345-192.168.203.22@tcp:101:rm.0 00010000:00010000:2.0:1787381437.823535:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381437.823553:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0fb22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9536e1 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.823614:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fb29 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.823628:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fb29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.823640:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fb29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.823655:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fb30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.823662:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fb30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.823669:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fb30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.823799:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733800/0xbdc38ada7ea0fb37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.823809:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733800/0xbdc38ada7ea0fb37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.823816:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733800/0xbdc38ada7ea0fb37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787381437.823847:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787381437.823851:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787381437.823868:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733800/0xbdc38ada7ea0fb37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.823880:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733800/0xbdc38ada7ea0fb37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.823888:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fb29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.823894:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fb29 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.823900:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fb29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.823906:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681732800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381437.823911:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fb29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.824235:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fb29 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.824256:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a1659f89a00) 00010000:00010000:2.0:1787381437.824259:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381437.824264:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fb29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.824271:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fb29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.824288:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fb30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.824294:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fb30 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.824300:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fb30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.824306:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681732a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381437.824308:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fb30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.824314:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fb30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.824322:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x48a8de3 (ffff9a1650b8f500) 00010000:00010000:2.0:1787381437.824325:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381437.824328:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fb30 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.824333:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fb30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.824379:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0fb22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536e1 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.824392:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733800/0xbdc38ada7ea0fb37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536e1 expref: 17 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.824410:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a1650b8fb00) 00010000:00010000:2.0:1787381437.824413:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787381437.824415:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1681733800, rc 0) 00000100:00100000:2.0:1787381437.824482:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f562a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+17:9658:x1874205047017088:12345-192.168.203.22@tcp:101:rm.0 Request processed in 967us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381437.824491:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 29 00000100:00100000:2.0:1787381437.834454:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381437.834627:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047017344 00000100:00100000:3.0:1787381437.834636:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047017344 00000100:00100000:3.0:1787381437.834700:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 30 00000100:00100000:3.0:1787381437.834710:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+17:9658:x1874205047017344:12345-192.168.203.22@tcp:36:rm.0 00010000:00010000:3.0:1787381437.834763:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787381437.834790:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733800/0xbdc38ada7ea0fb37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536e1 expref: 17 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.834813:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea0fae3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536c5 expref: 16 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.834845:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a1650b8fb00) 00010000:00010000:3.0:1787381437.835094:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733a00/0xbdc38ada7ea0faf8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536cc expref: 15 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.835107:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a1659f89a00) 00010000:00010000:3.0:1787381437.835112:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787381437.835134:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea0fb3e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.835147:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea0fb3e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.835157:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea0fb3e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.835171:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1600/0xbdc38ada7ea0fb45 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.835178:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1600/0xbdc38ada7ea0fb45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.835185:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1600/0xbdc38ada7ea0fb45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.835308:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1000/0xbdc38ada7ea0fb4c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.835317:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1000/0xbdc38ada7ea0fb4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.835334:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1000/0xbdc38ada7ea0fb4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787381437.836630:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1787381437.836766:0:5791:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 295967760627ns, next at 296967635846ns, rc = 0 00010000:00010000:3.0:1787381437.837294:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea0fb53 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.837311:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea0fb53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.837322:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea0fb53 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.837330:0:5791:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea0fb53 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.837337:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea0fb53 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.837343:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea0fb53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.837456:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787381437.837484:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1000/0xbdc38ada7ea0fb4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.837490:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1000/0xbdc38ada7ea0fb4c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.837497:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1000/0xbdc38ada7ea0fb4c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.837519:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb1000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381437.837524:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1000/0xbdc38ada7ea0fb4c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.837531:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1000/0xbdc38ada7ea0fb4c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.837545:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a1643052a00) 00010000:00010000:3.0:1787381437.837547:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787381437.837552:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1000/0xbdc38ada7ea0fb4c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.837558:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1000/0xbdc38ada7ea0fb4c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.837578:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea0fb3e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.837584:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea0fb3e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.837590:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea0fb3e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.837595:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb0600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381437.837598:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea0fb3e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.837603:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea0fb3e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.837619:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a1659f89a00) 00010000:00010000:3.0:1787381437.837622:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381437.837624:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea0fb3e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.837631:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea0fb3e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787381437.837640:0:5791:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c398f946 reply state 00000000e1654eb5 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1600/0xbdc38ada7ea0fb45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381437.837659:0:5791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787381437.837760:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+16:9658:x1874205047017344:12345-192.168.203.22@tcp:36:rm.0 Request processed in 3048us (3312us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787381437.837769:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 30 00010000:00010000:1.0:1787381437.839466:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787381437.839481:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea0fb53 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.839493:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb0a00 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:1.0:1787381437.839497:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea0fb53 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.839507:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea0fb53 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.839528:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9a1643052a00) 00010000:00010000:1.0:1787381437.839531:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787381437.839535:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea0fb53 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.839563:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea0fb53 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381437.839591:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381437.839594:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381437.839595:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381437.840630:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1600/0xbdc38ada7ea0fb45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.840717:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1600/0xbdc38ada7ea0fb45 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.840727:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1600/0xbdc38ada7ea0fb45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.840732:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb1600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381437.840736:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1600/0xbdc38ada7ea0fb45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.840745:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1600/0xbdc38ada7ea0fb45 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.840775:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x48a8de3 (ffff9a1643052800) 00010000:00010000:3.0:1787381437.840777:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381437.840781:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1600/0xbdc38ada7ea0fb45 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.840787:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1600/0xbdc38ada7ea0fb45 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381437.844078:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381437.847918:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047017600 00000100:00100000:0.0:1787381437.847935:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047017600 00000100:00100000:0.0:1787381437.848058:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:0.0:1787381437.848071:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+15:9658:x1874205047017600:12345-192.168.203.22@tcp:35:rm.0 00000100:00100000:0.0:1787381437.848366:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+16:9658:x1874205047017600:12345-192.168.203.22@tcp:35:rm.0 Request processed in 298us (4299us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787381437.848374:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:1.0:1787381437.851222:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381437.851368:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047017856 00000100:00100000:3.0:1787381437.851378:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047017856 00000100:00100000:3.0:1787381437.851453:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 31 00000100:00100000:3.0:1787381437.851464:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f562680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+16:9658:x1874205047017856:12345-192.168.203.22@tcp:36:rm.0 00010000:00010000:3.0:1787381437.851523:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787381437.851551:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0c00/0xbdc38ada7ea0fb14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536da expref: 16 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.851585:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea0fab2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536b7 expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.851596:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a1659f89a00) 00010000:00010000:3.0:1787381437.851610:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea0fa73 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536a9 expref: 14 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.851618:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1659f89900) 00010000:00010000:3.0:1787381437.851624:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787381437.851726:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1600/0xbdc38ada7ea0fb5a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.851756:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1600/0xbdc38ada7ea0fb5a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.851765:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1600/0xbdc38ada7ea0fb5a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.851779:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea0fb61 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.851785:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea0fb61 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.851866:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea0fb61 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.852477:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1000/0xbdc38ada7ea0fb68 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.852488:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1000/0xbdc38ada7ea0fb68 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.852495:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1000/0xbdc38ada7ea0fb68 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787381437.855243:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787381437.855404:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1000/0xbdc38ada7ea0fb68 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.855464:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1000/0xbdc38ada7ea0fb68 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.855472:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1000/0xbdc38ada7ea0fb68 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.855490:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb1000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381437.855495:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1000/0xbdc38ada7ea0fb68 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.855503:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1000/0xbdc38ada7ea0fb68 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.855520:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9a1643052100) 00010000:00010000:3.0:1787381437.855523:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787381437.855527:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1000/0xbdc38ada7ea0fb68 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.855534:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1000/0xbdc38ada7ea0fb68 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.855562:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1600/0xbdc38ada7ea0fb5a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.855569:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1600/0xbdc38ada7ea0fb5a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.855574:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1600/0xbdc38ada7ea0fb5a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.855578:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb1600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381437.855580:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1600/0xbdc38ada7ea0fb5a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.855586:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1600/0xbdc38ada7ea0fb5a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.855604:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1643052800) 00010000:00010000:3.0:1787381437.855607:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381437.855610:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1600/0xbdc38ada7ea0fb5a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381437.855615:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1600/0xbdc38ada7ea0fb5a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787381437.855630:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009dcbff41 reply state 000000004e548c43 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea0fb61 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381437.855638:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787381437.855981:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f562680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+15:9658:x1874205047017856:12345-192.168.203.22@tcp:36:rm.0 Request processed in 4514us (4762us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787381437.855991:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 31 00010000:00010000:2.0:1787381437.859874:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea0fb61 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.859899:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea0fb61 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.859908:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea0fb61 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.859915:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb0600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381437.859919:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea0fb61 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.859928:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea0fb61 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.860294:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9a1643052000) 00010000:00010000:2.0:1787381437.860297:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381437.860301:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea0fb61 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381437.860308:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea0fb61 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381438.284355:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f931f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065923968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787381438.284434:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381438.284698:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065923968 00000100:00100000:1.0:1787381438.284707:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065923968 00000100:00100000:1.0:1787381438.284763:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787381438.284774:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a52b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065923968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787381438.284815:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787381438.284871:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a52b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065923968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381438.284878:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1787381438.285068:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a166f931f80 x1874205065923968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381454 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787381438.285087:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f931f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065923968:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787381438.348209:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381439.374938:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787381439.642368:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381439.642421:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381439.642445:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381439.642473:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381439.642710:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047018112 00000100:00100000:2.0:1787381439.642720:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047018112 00000100:00100000:2.0:1787381439.642787:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047018368 00000100:00100000:2.0:1787381439.642790:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047018368 00000100:00100000:2.0:1787381439.642820:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 97 00000100:00100000:2.0:1787381439.642829:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f930700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+14:2349:x1874205047018112:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787381439.642913:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f930700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+14:2349:x1874205047018112:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 84us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381439.642920:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 97 00000100:00100000:2.0:1787381439.642936:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 98 00000100:00100000:2.0:1787381439.642942:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f933800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2349:x1874205047018368:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787381439.642964:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f933800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2349:x1874205047018368:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 23us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381439.642970:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 98 00000100:00100000:2.0:1787381439.643363:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047017984 00000100:00100000:2.0:1787381439.643368:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047017984 00000100:00100000:2.0:1787381439.643418:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 248 00000100:00100000:2.0:1787381439.643425:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2350:x1874205047017984:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787381439.643457:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2350:x1874205047017984:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 32us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381439.643463:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 248 00000100:00100000:2.0:1787381439.643526:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047018240 00000100:00100000:2.0:1787381439.643530:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047018240 00000100:00100000:2.0:1787381439.643620:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:2.0:1787381439.643627:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2157c09-10df-40cb-8228-ad4822122c97+5:2350:x1874205047018240:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787381439.643657:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2157c09-10df-40cb-8228-ad4822122c97+5:2350:x1874205047018240:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 31us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381439.643664:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00080000:1.0:1787381439.646910:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787381439.646921:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787381440.397132:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381441.420319:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787381441.594121:0:11460:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1787381442.444273:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787381442.474732:0:11508:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffe27b03ec0 00000020:00000080:0.0:1787381442.474749:0:11508:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:0.0:1787381442.474754:0:11508:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:0.0:1787381442.474762:0:11508:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe27b06150 20000000:00000080:0.0:1787381442.474770:0:11508:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a1646541c00 uarg=0000000000000000 20000000:01000000:0.0:1787381442.474807:0:11508:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787381442.474813:0:11508:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1787381442.474818:0:11508:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1787381442.475808:0:11509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1787381442.475971:0:11508:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1787381442.483300:0:11508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1787381442.483490:0:11508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1787381442.483559:0:11508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1787381442.483577:0:11508:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787381442.483595:0:11508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a16460c9800/0xbdc38ada7ea0fb6f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381442.483613:0:11508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a1640030a00/0xbdc38ada7ea0fa11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953694 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381442.483621:0:11508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a1647eb1e00/0xbdc38ada7ea0fa18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95369b expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381442.483629:0:11508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a1541389800/0xbdc38ada7ea0fa26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0fa1f expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381442.483634:0:11508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a1541388600/0xbdc38ada7ea0fa34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0fa2d expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381442.483640:0:11508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a1640030000/0xbdc38ada7ea0fa42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0fa3b expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381442.483647:0:11508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a16460c9800/0xbdc38ada7ea0fb6f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381442.483682:0:11508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a1640030000/0xbdc38ada7ea0fa42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbdc38ada7ea0fa3b expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381442.483697:0:11508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a1640030000/0xbdc38ada7ea0fa42 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbdc38ada7ea0fa3b expref: 18 pid: 5783 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381442.483711:0:11508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167ab42d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11508:1874205065924096:0@lo:104: 00000100:00100000:0.0:1787381442.483783:0:11508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787381442.483834:0:11508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a1541388600/0xbdc38ada7ea0fa34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbdc38ada7ea0fa2d expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381442.483843:0:11508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a1541388600/0xbdc38ada7ea0fa34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbdc38ada7ea0fa2d expref: 18 pid: 5784 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381442.483852:0:11508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167ab43b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11508:1874205065924224:0@lo:104: 00000100:00100000:0.0:1787381442.483874:0:11508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787381442.483895:0:11508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a1541389800/0xbdc38ada7ea0fa26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbdc38ada7ea0fa1f expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381442.483903:0:11508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9a1541389800/0xbdc38ada7ea0fa26 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbdc38ada7ea0fa1f expref: 18 pid: 5783 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381442.483912:0:11508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167ab40e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11508:1874205065924352:0@lo:104: 00000100:00100000:0.0:1787381442.483933:0:11508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787381442.483950:0:11508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a1647eb1e00/0xbdc38ada7ea0fa18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95369b expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381442.483960:0:11508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a1647eb1e00/0xbdc38ada7ea0fa18 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95369b expref: 12 pid: 5783 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381442.483970:0:11508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167ab41180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11508:1874205065924480:192.168.203.22@tcp:104: 00000100:00100000:2.0:1787381442.484933:0:5773:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787381442.484950:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065924096 00000100:00100000:2.0:1787381442.484957:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065924096 00000100:00100000:2.0:1787381442.484995:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065924224 00000100:00100000:2.0:1787381442.484998:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065924224 00000100:00100000:2.0:1787381442.485026:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065924352 00000100:00100000:2.0:1787381442.485029:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065924352 00000100:00100000:2.0:1787381442.485056:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787381442.485066:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167ab41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+5:11508:x1874205065924096:12345-0@lo:104: 00010000:00010000:2.0:1787381442.485079:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9a1640030600/0xbdc38ada7ea0fa3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0fa42 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381442.485134:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787381442.485140:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167ab41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+5:11508:x1874205065924096:12345-0@lo:104: Request processed in 76us (1358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381442.485156:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787381442.485172:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787381442.485178:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167ab42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+4:11508:x1874205065924224:12345-0@lo:104: 00010000:00010000:2.0:1787381442.485186:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9a1681733000/0xbdc38ada7ea0fa2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0fa34 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381442.485220:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787381442.485226:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167ab42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+4:11508:x1874205065924224:12345-0@lo:104: Request processed in 48us (1351us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381442.485243:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787381442.485256:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787381442.485262:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f4dc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+3:11508:x1874205065924352:12345-0@lo:104: 00010000:00010000:2.0:1787381442.485269:0:5773:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9a1640031e00/0xbdc38ada7ea0fa1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0fa26 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381442.485297:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787381442.485303:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f4dc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cd19486c-5291-4823-bb9c-f3a73416a496+3:11508:x1874205065924352:12345-0@lo:104: Request processed in 42us (1369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381442.485308:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1787381442.485360:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787381442.485377:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a1640030600/0xbdc38ada7ea0fa3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0fa42 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381442.485385:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1640030600 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:2.0:1787381442.485389:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a1640030600/0xbdc38ada7ea0fa3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbdc38ada7ea0fa42 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381442.485408:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a1640030600/0xbdc38ada7ea0fa3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbdc38ada7ea0fa42 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787381442.485415:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a1640030600/0xbdc38ada7ea0fa3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbdc38ada7ea0fa42 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787381442.485421:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787381442.485453:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a1640030600/0xbdc38ada7ea0fa3b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0fa42 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381442.485460:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787381442.485480:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a1640030600/0xbdc38ada7ea0fa3b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0fa42 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381442.485487:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a1640030600/0xbdc38ada7ea0fa3b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0fa42 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381442.485501:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787381442.485504:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a1681733000/0xbdc38ada7ea0fa2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0fa34 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381442.485510:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681733000 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:2.0:1787381442.485513:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a1681733000/0xbdc38ada7ea0fa2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbdc38ada7ea0fa34 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381442.485520:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a1681733000/0xbdc38ada7ea0fa2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbdc38ada7ea0fa34 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787381442.485538:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a1681733000/0xbdc38ada7ea0fa2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbdc38ada7ea0fa34 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787381442.485551:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787381442.485568:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a1681733000/0xbdc38ada7ea0fa2d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0fa34 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381442.485574:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787381442.485581:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a1681733000/0xbdc38ada7ea0fa2d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0fa34 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381442.485588:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a1681733000/0xbdc38ada7ea0fa2d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0fa34 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381442.485599:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787381442.485603:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a1640031e00/0xbdc38ada7ea0fa1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea0fa26 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381442.485609:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1640031e00 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:2.0:1787381442.485612:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a1640031e00/0xbdc38ada7ea0fa1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbdc38ada7ea0fa26 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381442.485619:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a1640031e00/0xbdc38ada7ea0fa1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbdc38ada7ea0fa26 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787381442.485626:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a1640031e00/0xbdc38ada7ea0fa1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbdc38ada7ea0fa26 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787381442.485632:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787381442.485644:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a1640031e00/0xbdc38ada7ea0fa1f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0fa26 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381442.485650:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787381442.485673:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a1640031e00/0xbdc38ada7ea0fa1f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0fa26 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381442.485680:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a1640031e00/0xbdc38ada7ea0fa1f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea0fa26 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381442.485698:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381442.485701:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381442.485703:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381442.485710:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787381442.485735:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a52bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065924608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787381442.485769:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381442.485802:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787381442.485808:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a52b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065924736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787381442.485827:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381442.485851:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a529880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd19486c-5291-4823-bb9c-f3a73416a496:3310:1874205065924864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787381442.485872:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381442.485900:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065924608 00000100:00100000:2.0:1787381442.485904:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065924608 00010000:00010000:2.0:1787381442.485922:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a1640030000/0xbdc38ada7ea0fa42 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0fa3b expref: 19 pid: 5783 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381442.485935:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065924736 00000100:00100000:2.0:1787381442.485937:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065924736 00010000:00010000:2.0:1787381442.485948:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a1541388600/0xbdc38ada7ea0fa34 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0fa2d expref: 20 pid: 5784 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381442.485957:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065924864 00000100:00100000:2.0:1787381442.485959:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065924864 00010000:00010000:2.0:1787381442.485967:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a1541389800/0xbdc38ada7ea0fa26 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0fa1f expref: 21 pid: 5783 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381442.485987:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787381442.485993:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a528700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd19486c-5291-4823-bb9c-f3a73416a496+21:3308:x1874205065924608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787381442.486031:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381442.486038:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a1640030000/0xbdc38ada7ea0fa42 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0fa3b expref: 21 pid: 5783 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381442.486050:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a1640030000/0xbdc38ada7ea0fa42 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbdc38ada7ea0fa3b expref: 21 pid: 5783 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381442.486065:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787381442.486094:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a528700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd19486c-5291-4823-bb9c-f3a73416a496+21:3308:x1874205065924608:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381442.486099:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787381442.486112:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787381442.486118:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f920000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd19486c-5291-4823-bb9c-f3a73416a496+20:3308:x1874205065924736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787381442.486125:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381442.486129:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a1541388600/0xbdc38ada7ea0fa34 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0fa2d expref: 20 pid: 5784 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381442.486138:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a1541388600/0xbdc38ada7ea0fa34 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbdc38ada7ea0fa2d expref: 20 pid: 5784 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381442.486147:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787381442.486167:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f920000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd19486c-5291-4823-bb9c-f3a73416a496+20:3308:x1874205065924736:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381442.486173:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787381442.486185:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787381442.486197:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166d05c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd19486c-5291-4823-bb9c-f3a73416a496+19:3310:x1874205065924864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787381442.486204:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381442.486208:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a1541389800/0xbdc38ada7ea0fa26 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea0fa1f expref: 19 pid: 5783 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381442.486217:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a1541389800/0xbdc38ada7ea0fa26 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbdc38ada7ea0fa1f expref: 19 pid: 5783 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381442.486225:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787381442.486251:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166d05c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd19486c-5291-4823-bb9c-f3a73416a496+19:3310:x1874205065924864:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381442.486257:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787381442.486313:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a529880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd19486c-5291-4823-bb9c-f3a73416a496:3310:1874205065924864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787381442.486335:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a52b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065924736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787381442.486343:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a52bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065924608:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787381442.486468:0:11508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a1640030a00/0xbdc38ada7ea0fa11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953694 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381442.486479:0:11508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a1640030a00/0xbdc38ada7ea0fa11 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953694 expref: 12 pid: 5783 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381442.486502:0:11508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167ab40380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11508:1874205065924992:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787381442.486543:0:11508:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1675018480 going to sleep for 11 seconds 00010000:00010000:0.0:1787381442.486555:0:11508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1640030000/0xbdc38ada7ea0fa42 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbdc38ada7ea0fa3b expref: 18 pid: 5783 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381442.486565:0:11508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167ab42d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11508:1874205065924096:0@lo:104: 00010000:00010000:0.0:1787381442.486573:0:11508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1541388600/0xbdc38ada7ea0fa34 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbdc38ada7ea0fa2d expref: 17 pid: 5784 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381442.486579:0:11508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167ab43b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11508:1874205065924224:0@lo:104: 00010000:00010000:0.0:1787381442.486586:0:11508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1541389800/0xbdc38ada7ea0fa26 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbdc38ada7ea0fa1f expref: 16 pid: 5783 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381442.486592:0:11508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167ab40e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11508:1874205065924352:0@lo:104: 00000100:00100000:1.0:1787381442.494153:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381442.494201:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381442.494511:0:11508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167ab41180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11508:1874205065924480:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787381442.494524:0:11508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167ab40380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11508:1874205065924992:192.168.203.22@tcp:104: 00010000:00010000:0.0:1787381442.494562:0:11508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a16460c9800/0xbdc38ada7ea0fb6f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381442.495801:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047018496 00000100:00100000:2.0:1787381442.495813:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047018496 00010000:00010000:2.0:1787381442.495851:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a1647eb1e00/0xbdc38ada7ea0fa18 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95369b expref: 13 pid: 5783 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381442.496243:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047018624 00000100:00100000:2.0:1787381442.496248:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047018624 00010000:00010000:2.0:1787381442.496265:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a1640030a00/0xbdc38ada7ea0fa11 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953694 expref: 14 pid: 5783 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381442.496482:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 33 00000100:00100000:1.0:1787381442.496502:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f931880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c93c8548-229c-4d2f-8357-13904b6fe0fb+14:2350:x1874205047018496:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787381442.496518:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381442.496535:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a1647eb1e00/0xbdc38ada7ea0fa18 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95369b expref: 14 pid: 5783 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381442.496547:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a1647eb1e00/0xbdc38ada7ea0fa18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95369b expref: 14 pid: 5783 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381442.496565:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1647eb1e00/0xbdc38ada7ea0fa18 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95369b expref: 14 pid: 5783 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381442.496579:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381442.496717:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f931880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2350:x1874205047018496:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 216us (2572us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381442.496726:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 33 00000100:00100000:1.0:1787381442.496745:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 34 00000100:00100000:1.0:1787381442.496752:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f930a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c93c8548-229c-4d2f-8357-13904b6fe0fb+12:2350:x1874205047018624:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787381442.496761:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381442.496766:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a1640030a00/0xbdc38ada7ea0fa11 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953694 expref: 12 pid: 5783 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381442.496775:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a1640030a00/0xbdc38ada7ea0fa11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953694 expref: 12 pid: 5783 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381442.496786:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1640030a00/0xbdc38ada7ea0fa11 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953694 expref: 12 pid: 5783 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381442.496797:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a16460c9800/0xbdc38ada7ea0fb6f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381442.496811:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a16460c9800/0xbdc38ada7ea0fb6f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381442.496827:0:5775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a16460c9800/0xbdc38ada7ea0fb6f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381442.496834:0:5775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a16460c9800/0xbdc38ada7ea0fb6f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381442.496841:0:5775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a16460c9800/0xbdc38ada7ea0fb6f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381442.496847:0:5775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a16460c9800/0xbdc38ada7ea0fb6f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381442.496853:0:5775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c9800 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:1.0:1787381442.496858:0:5775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a16460c9800/0xbdc38ada7ea0fb6f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381442.496880:0:5775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a16460c9800/0xbdc38ada7ea0fb6f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381442.496895:0:5775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a16460c9800/0xbdc38ada7ea0fb6f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381442.496905:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381442.496925:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f930a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c93c8548-229c-4d2f-8357-13904b6fe0fb+11:2350:x1874205047018624:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 174us (2723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381442.496932:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 34 00010000:00010000:0.0:1787381442.497633:0:11508:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a16460c9800/0xbdc38ada7ea0fb6f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381442.497644:0:11508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a16460c9800/0xbdc38ada7ea0fb6f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381442.497650:0:11508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a16460c9800/0xbdc38ada7ea0fb6f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787381442.892358:0:6784:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 301023350831ns, next at 302023348329ns, rc = 0 00000100:00100000:2.0:1787381442.892409:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065925120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787381442.892410:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065925248:0@lo:400:kworker.0 00000100:00100000:1.0:1787381442.892603:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1874205065925504:0@lo:400:kworker.0 00000100:00100000:2.0:1787381442.892835:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381442.892882:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065925632:0@lo:400:kworker.0 00000100:00100000:2.0:1787381442.892904:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381442.892936:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065925120 00000100:00100000:2.0:1787381442.893390:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065925120 00000100:00100000:2.0:1787381442.893445:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787381442.893454:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065925120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787381442.893486:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787381442.893534:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065925120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381442.893541:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787381442.893564:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065925632 00000100:00100000:2.0:1787381442.893568:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065925632 00000100:00100000:2.0:1787381442.893592:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787381442.893598:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f920000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065925632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381442.893628:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f920000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065925632:12345-0@lo:400:kworker.0 Request processed in 30us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381442.893634:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1787381442.893649:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787381442.893680:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a166f920380 x1874205065925120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787381442.893698:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f920380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065925120:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1787381442.893709:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a33c380 x1874205065925632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787381458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787381442.893717:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065925632:0@lo:400:kworker.0 00000100:00100000:2.0:1787381442.893766:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874205065925376:0@lo:400:kworker.0 00000100:00100000:2.0:1787381442.893807:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381442.893825:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065925888:0@lo:400:kworker.0 00000100:00100000:2.0:1787381442.893843:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381442.893871:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065925888 00000100:00100000:2.0:1787381442.893875:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065925888 00000100:00100000:2.0:1787381442.893897:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787381442.893903:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a52bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065925888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381442.893932:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a52bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065925888:12345-0@lo:400:kworker.0 Request processed in 29us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381442.893938:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1787381442.893965:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787381442.893979:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a33d880 x1874205065925888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787381458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787381442.893988:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065925888:0@lo:400:kworker.0 00000100:00100000:2.0:1787381442.894025:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065925376 00000100:00100000:2.0:1787381442.894028:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065925376 00000100:00100000:2.0:1787381442.894052:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787381442.894058:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874205065925376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381442.894090:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874205065925376:12345-0@lo:400:kworker.0 Request processed in 32us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381442.894096:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787381442.894123:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874205065925376:0@lo:400:kworker.0 00000100:00100000:3.0:1787381442.899695:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381442.899807:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381442.900069:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065925504 00000100:00100000:1.0:1787381442.900078:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065925504 00000100:00100000:3.0:1787381442.900083:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065925248 00000100:00100000:3.0:1787381442.900135:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065925248 00000100:00100000:1.0:1787381442.900135:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787381442.900149:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f933100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874205065925504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787381442.900171:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1787381442.900180:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+16:3308:x1874205065925248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381442.900312:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f933100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874205065925504:12345-0@lo:400:kworker.0 Request processed in 166us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381442.900320:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:1.0:1787381442.900414:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787381442.900446:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+16:3308:x1874205065925248:12345-0@lo:400:kworker.0 Request processed in 266us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381442.900465:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1787381442.900538:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065925248:0@lo:400:kworker.0 00000100:00100000:1.0:1787381442.900540:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1874205065925504:0@lo:400:kworker.0 00000100:00100000:3.0:1787381442.900555:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1874205065925760:0@lo:400:kworker.0 00000100:00100000:3.0:1787381442.900587:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381442.900614:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065925760 00000100:00100000:3.0:1787381442.900618:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065925760 00000100:00100000:3.0:1787381442.900653:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787381442.900661:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a33ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874205065925760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787381442.900689:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a33ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874205065925760:12345-0@lo:400:kworker.0 Request processed in 30us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381442.900695:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:3.0:1787381442.900708:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787381442.900726:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1874205065925760:0@lo:400:kworker.0 00000001:00080000:2.0:1787381442.946752:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:2.0:1787381442.946771:0:5813:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:2.0:1787381442.946820:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1787381442.946830:0:5813:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1787381442.947144:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787381442.947165:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167ab40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065926016:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787381442.947225:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381442.947317:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065926016 00000100:00100000:0.0:1787381442.947325:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065926016 00000100:00100000:2.0:1787381442.947512:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787381442.947533:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a52b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065926016:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787381442.947558:0:6588:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1787381442.947600:0:6588:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a8946bc, atime: 0x6a8946bc, ctime: 0x6a8946bc, blocks: 0x1 00010000:00010000:2.0:1787381442.947609:0:6588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095589095/0xbdc38ada7ea0fb76 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381442.947624:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=301s v=(0 0) 00010000:00010000:2.0:1787381442.947628:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787381442.947635:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095589095/0xbdc38ada7ea0fb76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381442.947652:0:6588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095589095/0xbdc38ada7ea0fb76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381442.947662:0:6588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095589095/0xbdc38ada7ea0fb76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381442.947679:0:6588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095589095/0xbdc38ada7ea0fb76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381442.947702:0:6588:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787381442.947786:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787381442.947793:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095589095/0xbdc38ada7ea0fb76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381442.947803:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681733000 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:1.0:1787381442.947808:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095589095/0xbdc38ada7ea0fb76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381442.947827:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095589095/0xbdc38ada7ea0fb76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381442.947847:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095589095/0xbdc38ada7ea0fb76 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381442.947854:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095589095/0xbdc38ada7ea0fb76 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381442.947992:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381442.947994:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381442.947997:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787381442.948425:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a52b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1874205065926016:12345-0@lo:6:osp-syn-0-0.0 Request processed in 902us (1197us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787381442.948442:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:3.0:1787381442.948546:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a167ab40380/2, rc 0, transno 4294967300 00000100:00100000:3.0:1787381442.948554:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167ab40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065926016:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787381443.405618:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065926144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787381443.405704:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381443.406331:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065926144 00000100:00100000:1.0:1787381443.406340:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065926144 00000100:00100000:1.0:1787381443.406408:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787381443.406418:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a33e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065926144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787381443.406466:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787381443.406526:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a33e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065926144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381443.406532:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1787381443.406627:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a166f932d80 x1874205065926144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381459 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381443.406647:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065926144:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787381443.469046:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787381443.532169:0:5787:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787381443.532178:0:5787:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a16436a3000 from 7 10000000:01000000:2.0:1787381443.532183:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787381443.532233:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1681732e00/0xbdc38ada7ea0fb7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381443.532245:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a1681732e00/0xbdc38ada7ea0fb7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381443.532255:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a1681732e00/0xbdc38ada7ea0fb7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381443.532282:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a529880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065926272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787381443.532352:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381443.532436:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1645a34480 going to sleep for 11 seconds 00000100:00100000:3.0:1787381443.532437:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065926272 00000100:00100000:3.0:1787381443.532454:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065926272 00000100:00100000:3.0:1787381443.532515:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1787381443.532526:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+16:5787:x1874205065926272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787381443.532542:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381443.532556:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1647eb1000/0xbdc38ada7ea0fb84 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0fb7d expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381443.532598:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1647eb1000/0xbdc38ada7ea0fb84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0fb7d expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381443.532609:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1647eb1000/0xbdc38ada7ea0fb84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0fb7d expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381443.532618:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb1000, rc 0) 00000100:00100000:3.0:1787381443.532668:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+17:5787:x1874205065926272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381443.532675:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1787381443.532836:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a529880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065926272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787381443.532851:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a1681732e00/0xbdc38ada7ea0fb7d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0fb84 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381443.532861:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a1681732e00/0xbdc38ada7ea0fb7d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0fb84 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381443.532913:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a529880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065926400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787381443.532938:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381443.532958:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1645a34480 going to sleep for 11 seconds 00000100:00100000:3.0:1787381443.533087:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065926400 00000100:00100000:3.0:1787381443.533091:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065926400 00000100:00100000:3.0:1787381443.533126:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1787381443.533142:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+17:5787:x1874205065926400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787381443.533385:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+17:5787:x1874205065926400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 252us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381443.533393:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787381443.533639:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a529880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065926400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787381443.533674:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a529880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065926528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787381443.533704:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381443.533730:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1645a34480 going to sleep for 11 seconds 00000100:00100000:3.0:1787381443.533813:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065926528 00000100:00100000:3.0:1787381443.533817:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065926528 00000100:00100000:3.0:1787381443.533848:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1787381443.533855:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+17:5787:x1874205065926528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787381443.534592:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a529880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065926528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787381443.535280:0:11523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f931c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:11523:1874205065926656:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787381443.535339:0:11523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381443.535557:0:11523:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1644f1d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787381443.535603:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065926656 00000100:00100000:2.0:1787381443.535609:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065926656 00000100:00100000:2.0:1787381443.535682:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787381443.535691:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+18:11523:x1874205065926656:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787381443.535918:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+18:11523:x1874205065926656:12345-0@lo:502:llog_process_th.0 Request processed in 227us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381443.535925:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1787381443.536122:0:11523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f931c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:11523:1874205065926656:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787381443.536152:0:11523:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787381443.536162:0:11523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787381443.536164:0:11523:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787381443.536171:0:11523:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a16436a3000 00000020:00000080:1.0:1787381443.536173:0:11523:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787381443.536244:0:11523:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f931c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:11523:1874205065926784:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787381443.536284:0:11523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381443.536497:0:11523:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1644f1d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787381443.538515:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065926784 00000100:00100000:2.0:1787381443.538528:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065926784 00000100:00100000:2.0:1787381443.538565:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787381443.538574:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+18:11523:x1874205065926784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787381443.538823:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+18:11523:x1874205065926784:12345-0@lo:502:llog_process_th.0 Request processed in 248us (2537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381443.538831:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787381443.539298:0:11523:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f931c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:11523:1874205065926784:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787381443.539331:0:11523:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787381443.539339:0:11523:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787381443.539341:0:11523:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787381443.539345:0:11523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787381443.540117:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787381443.540142:0:5787:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787381443.540152:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1681732e00/0xbdc38ada7ea0fb7d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0fb84 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381443.540164:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a1681732e00/0xbdc38ada7ea0fb7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0fb84 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787381443.540174:0:5787:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787381443.540176:0:5787:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a1646496800 from 7 10000000:01000000:2.0:1787381443.540179:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787381443.540210:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1681733c00/0xbdc38ada7ea0fb8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381443.540218:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a1681733c00/0xbdc38ada7ea0fb8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381443.540227:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a1681733c00/0xbdc38ada7ea0fb8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381443.540247:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a529880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065926912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787381443.540295:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381443.540315:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1645a34540 going to sleep for 11 seconds 00000100:00100000:2.0:1787381443.540332:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065926912 00000100:00100000:2.0:1787381443.540337:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065926912 00000100:00100000:2.0:1787381443.540740:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1787381443.540749:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646ea5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+18:5787:x1874205065926912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787381443.540761:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381443.540774:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1681732400/0xbdc38ada7ea0fb92 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0fb8b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381443.540810:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1681732400/0xbdc38ada7ea0fb92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0fb8b expref: 19 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381443.540820:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1681732400/0xbdc38ada7ea0fb92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0fb8b expref: 19 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381443.540829:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1681732400, rc 0) 00000100:00100000:2.0:1787381443.540867:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+19:5787:x1874205065926912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381443.540874:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1787381443.540911:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a529880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065926912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787381443.540923:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a1681733c00/0xbdc38ada7ea0fb8b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0fb92 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381443.540932:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a1681733c00/0xbdc38ada7ea0fb8b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0fb92 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381443.541528:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a529880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065927040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787381443.541564:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381443.541581:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1645a34540 going to sleep for 11 seconds 00000100:00100000:2.0:1787381443.541595:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065927040 00000100:00100000:2.0:1787381443.541599:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065927040 00000100:00100000:2.0:1787381443.541619:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1787381443.541625:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16461b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+19:5787:x1874205065927040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787381443.541843:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16461b2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+19:5787:x1874205065927040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 216us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381443.541859:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1787381443.541894:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a529880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065927040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787381443.541921:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a529880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065927168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787381443.543576:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646ea6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+18:5787:x1874205065926528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 9713us (9862us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381443.543588:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787381443.546535:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381443.546582:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1645b1fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787381443.546666:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065927168 00000100:00100000:3.0:1787381443.546676:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065927168 00000100:00100000:3.0:1787381443.546740:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787381443.546751:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+18:5787:x1874205065927168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787381443.547308:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+18:5787:x1874205065927168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 557us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381443.547317:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787381443.551297:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a529880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065927168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787381443.552646:0:11526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:11526:1874205065927296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787381443.552725:0:11526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381443.552768:0:11526:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fe15d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787381443.552822:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065927296 00000100:00100000:2.0:1787381443.552829:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065927296 00000100:00100000:2.0:1787381443.552879:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787381443.552887:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+18:11526:x1874205065927296:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787381443.553122:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+18:11526:x1874205065927296:12345-0@lo:502:llog_process_th.0 Request processed in 234us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381443.553129:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787381443.553139:0:11526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:11526:1874205065927296:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787381443.553166:0:11526:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787381443.553180:0:11526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787381443.553182:0:11526:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787381443.553190:0:11526:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a1646496800 00000020:00000080:1.0:1787381443.553194:0:11526:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787381443.553268:0:11526:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f933b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:11526:1874205065927424:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787381443.553301:0:11526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381443.553329:0:11526:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1644f1dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787381443.553384:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065927424 00000100:00100000:3.0:1787381443.553389:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065927424 00000100:00100000:3.0:1787381443.553428:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787381443.553435:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+18:11526:x1874205065927424:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787381443.553563:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+18:11526:x1874205065927424:12345-0@lo:502:llog_process_th.0 Request processed in 127us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381443.553570:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1787381443.553606:0:11526:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f933b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:11526:1874205065927424:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787381443.553623:0:11526:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787381443.553628:0:11526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787381443.553630:0:11526:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787381443.553635:0:11526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787381443.553886:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1787381443.553905:0:5787:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787381443.553915:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1681733c00/0xbdc38ada7ea0fb8b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0fb92 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381443.553927:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a1681733c00/0xbdc38ada7ea0fb8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0fb92 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787381443.553936:0:5787:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787381443.553939:0:5787:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a16659a7000 from 7 10000000:01000000:1.0:1787381443.553953:0:5787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787381443.553978:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea0fb99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381443.553987:0:5787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea0fb99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381443.553996:0:5787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea0fb99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381443.554044:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f932a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065927552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787381443.554078:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381443.554090:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1644f1d480 going to sleep for 11 seconds 00000100:00100000:3.0:1787381443.554182:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065927552 00000100:00100000:3.0:1787381443.554187:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065927552 00000100:00100000:3.0:1787381443.554225:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1787381443.554234:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+18:5787:x1874205065927552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787381443.554243:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381443.554256:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1647eb1600/0xbdc38ada7ea0fba0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea0fb99 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381443.554283:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1647eb1600/0xbdc38ada7ea0fba0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea0fb99 expref: 19 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381443.554293:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1647eb1600/0xbdc38ada7ea0fba0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea0fb99 expref: 19 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381443.554301:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb1600, rc 0) 00000100:00100000:3.0:1787381443.554331:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+19:5787:x1874205065927552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381443.554337:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1787381443.554407:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f932a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065927552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787381443.554430:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea0fb99 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0fba0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381443.554438:0:5787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea0fb99 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0fba0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381443.554491:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f932a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065927680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787381443.554515:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381443.554539:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1644f1d480 going to sleep for 11 seconds 00000100:00100000:3.0:1787381443.554628:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065927680 00000100:00100000:3.0:1787381443.554632:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065927680 00000100:00100000:3.0:1787381443.554664:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787381443.554670:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+19:5787:x1874205065927680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787381443.554864:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+19:5787:x1874205065927680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 193us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381443.554870:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787381443.554898:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f932a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065927680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787381443.554922:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065927808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787381443.555530:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381443.555554:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fe15b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787381443.555616:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065927808 00000100:00100000:1.0:1787381443.555621:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065927808 00000100:00100000:1.0:1787381443.555656:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787381443.555663:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+19:5787:x1874205065927808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787381443.555810:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+19:5787:x1874205065927808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381443.555818:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787381443.555891:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cd19486c-5291-4823-bb9c-f3a73416a496:5787:1874205065927808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787381443.566754:0:11527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:11527:1874205065927936:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787381443.566834:0:11527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381443.566889:0:11527:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fe15540 going to sleep for 11 seconds 00000100:00100000:2.0:1787381443.568109:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065927936 00000100:00100000:2.0:1787381443.568123:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065927936 00000100:00100000:2.0:1787381443.568178:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1787381443.568187:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+19:11527:x1874205065927936:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787381443.568443:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+19:11527:x1874205065927936:12345-0@lo:502:llog_process_th.0 Request processed in 255us (1607us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381443.568451:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1787381443.569811:0:11527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:11527:1874205065927936:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787381443.569849:0:11527:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787381443.569858:0:11527:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787381443.569860:0:11527:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787381443.569867:0:11527:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a16659a7000 00000020:00000080:1.0:1787381443.569870:0:11527:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787381443.569958:0:11527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f930e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:11527:1874205065928064:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787381443.570035:0:11527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381443.570066:0:11527:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1644f1d600 going to sleep for 11 seconds 00000100:00100000:0.0:1787381443.570643:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065928064 00000100:00100000:0.0:1787381443.570652:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065928064 00000100:00100000:0.0:1787381443.570724:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787381443.570734:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+19:11527:x1874205065928064:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787381443.570944:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+19:11527:x1874205065928064:12345-0@lo:502:llog_process_th.0 Request processed in 210us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381443.570952:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787381443.571025:0:11527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f930e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cd19486c-5291-4823-bb9c-f3a73416a496:11527:1874205065928064:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787381443.571051:0:11527:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787381443.571056:0:11527:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787381443.571058:0:11527:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787381443.571068:0:11527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787381443.571323:0:5787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787381443.571343:0:5787:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787381443.571353:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea0fb99 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0fba0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381443.571380:0:5787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea0fb99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0fba0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787381443.577538:0:11528:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787381443.719758:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381443.719958:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047018752 00000100:00100000:3.0:1787381443.719968:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047018752 00000100:00100000:3.0:1787381443.720060:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 265 00000100:00100000:3.0:1787381443.720071:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+11:5567:x1874205047018752:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787381443.720088:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381443.720105:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1647eb0c00/0xbdc38ada7ea0fba7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc01952459a9536e8 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381443.720133:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1647eb0c00/0xbdc38ada7ea0fba7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536e8 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381443.720147:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1647eb0c00/0xbdc38ada7ea0fba7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536e8 expref: 12 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381443.720157:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb0c00, rc 0) 00000100:00100000:3.0:1787381443.720218:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+12:5567:x1874205047018752:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 Request processed in 149us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381443.720226:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 265 00000100:00100000:0.0:1787381443.725598:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381443.725663:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047018880 00000100:00100000:2.0:1787381443.725673:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047018880 00000100:00100000:2.0:1787381443.725729:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 266 00000100:00100000:2.0:1787381443.725738:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+12:5567:x1874205047018880:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787381443.726750:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+12:5567:x1874205047018880:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 Request processed in 1008us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381443.726760:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 266 00000100:00100000:2.0:1787381443.734479:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381443.734627:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047019008 00000100:00100000:1.0:1787381443.734637:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047019008 00000100:00100000:1.0:1787381443.734692:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 267 00000100:00100000:1.0:1787381443.734702:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+12:5567:x1874205047019008:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787381443.734935:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+12:5567:x1874205047019008:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 Request processed in 233us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381443.734942:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 267 00000100:00100000:1.0:1787381443.740637:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381443.741339:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047019136 00000100:00100000:2.0:1787381443.741350:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047019136 00000100:00100000:2.0:1787381443.741416:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 268 00000100:00100000:2.0:1787381443.741426:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+12:9928:x1874205047019136:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787381443.741677:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+12:9928:x1874205047019136:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 251us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381443.741685:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 268 00000100:00100000:0.0:1787381443.758691:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381443.763750:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047019264 00000100:00100000:3.0:1787381443.763767:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047019264 00000100:00100000:2.0:1787381443.765987:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 269 00000100:00100000:2.0:1787381443.766000:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+12:9928:x1874205047019264:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787381443.766301:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+12:9928:x1874205047019264:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 300us (7619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381443.766686:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 269 00000100:00100000:0.0:1787381443.775166:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381443.775708:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047019392 00000100:00100000:2.0:1787381443.775718:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047019392 00000100:00100000:2.0:1787381443.775778:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 270 00000100:00100000:2.0:1787381443.775788:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+12:5567:x1874205047019392:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787381443.775819:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381443.775837:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1681733800/0xbdc38ada7ea0fbae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc01952459a9536ef expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381443.775866:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1681733800/0xbdc38ada7ea0fbae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536ef expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381443.775879:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1681733800/0xbdc38ada7ea0fbae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536ef expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381443.775888:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1681733800, rc 0) 00000100:00100000:2.0:1787381443.775954:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:5567:x1874205047019392:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 Request processed in 168us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381443.775962:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 270 00000100:00100000:3.0:1787381443.783573:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381443.783875:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047019520 00000100:00100000:2.0:1787381443.783885:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047019520 00000100:00100000:2.0:1787381443.783942:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 271 00000100:00100000:2.0:1787381443.783950:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:5567:x1874205047019520:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787381443.784468:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:5567:x1874205047019520:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 Request processed in 516us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381443.784476:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 271 00000100:00100000:0.0:1787381443.787808:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381443.787889:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047019648 00000100:00100000:1.0:1787381443.787898:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047019648 00000100:00100000:1.0:1787381443.787953:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 272 00000100:00100000:1.0:1787381443.787961:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:5567:x1874205047019648:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787381443.788220:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:5567:x1874205047019648:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 Request processed in 259us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381443.788229:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 272 00000100:00100000:0.0:1787381443.807235:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381443.807335:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047019776 00000100:00100000:2.0:1787381443.807344:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047019776 00000100:00100000:2.0:1787381443.807409:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 273 00000100:00100000:2.0:1787381443.807418:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646169c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:9931:x1874205047019776:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787381443.807673:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646169c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:9931:x1874205047019776:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 254us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381443.807688:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 273 00000100:00100000:3.0:1787381443.828651:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381443.829335:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047019904 00000100:00100000:0.0:1787381443.829347:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047019904 00000100:00100000:0.0:1787381443.829417:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 274 00000100:00100000:0.0:1787381443.829427:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:9931:x1874205047019904:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787381443.829687:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:9931:x1874205047019904:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 260us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381443.829695:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 274 00010000:00010000:1.0:1787381444.492241:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787381444.621600:0:11528:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787381444.755958:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381444.756690:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381444.756795:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381444.756835:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381444.757835:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047020032 00000100:00100000:3.0:1787381444.757847:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047020032 00000100:00100000:3.0:1787381444.757912:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 275 00000100:00100000:3.0:1787381444.757922:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2349:x1874205047020032:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787381444.758037:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047020288 00000100:00100000:0.0:1787381444.758042:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047020288 00000100:00100000:0.0:1787381444.758081:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 50 00000100:00100000:0.0:1787381444.758089:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167ab43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2157c09-10df-40cb-8228-ad4822122c97+5:2349:x1874205047020288:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787381444.758140:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167ab43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2157c09-10df-40cb-8228-ad4822122c97+5:2349:x1874205047020288:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 52us (1304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381444.758147:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 50 00000100:00080000:0.0:1787381444.758174:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787381444.758645:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2349:x1874205047020032:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 723us (1847us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381444.758653:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 275 00000100:00100000:1.0:1787381444.763043:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047020160 00000100:00100000:1.0:1787381444.763057:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047020160 00000100:00100000:1.0:1787381444.763132:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047020416 00000100:00100000:1.0:1787381444.763135:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047020416 00000100:00100000:1.0:1787381444.763169:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 102 00000100:00100000:1.0:1787381444.763178:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167ab41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+5:2349:x1874205047020160:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787381444.763262:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167ab41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+5:2349:x1874205047020160:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 84us (7312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381444.763271:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 102 00000100:00100000:1.0:1787381444.763289:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 103 00000100:00100000:1.0:1787381444.763309:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167ab40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2349:x1874205047020416:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787381444.763334:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167ab40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2349:x1874205047020416:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 27us (6647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381444.763486:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 103 00000100:00080000:0.0:1787381444.769078:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787381445.516184:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381446.540290:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381447.564153:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787381448.012382:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167ab42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065928192:0@lo:400:kworker.0 00000100:00100000:3.0:1787381448.012459:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381448.012476:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167ab40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065928576:0@lo:400:kworker.0 00000100:00100000:3.0:1787381448.012514:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167ab42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1874205065928704:0@lo:400:kworker.0 00000100:00100000:0.0:1787381448.012522:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381448.012553:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381448.012553:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787381448.012562:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167ab41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1874205065928448:0@lo:400:kworker.0 00000100:00100000:0.0:1787381448.012598:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065928192 00000100:00100000:0.0:1787381448.012605:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065928192 00000100:00100000:0.0:1787381448.012650:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787381448.012659:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+19:3308:x1874205065928192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381448.012709:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646168050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+19:3308:x1874205065928192:12345-0@lo:400:kworker.0 Request processed in 51us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381448.012718:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1787381448.012857:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167ab42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065928192:0@lo:400:kworker.0 00000100:00100000:3.0:1787381448.012874:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787381448.012882:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167ab42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874205065928320:0@lo:400:kworker.0 00000100:00100000:3.0:1787381448.012910:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381448.012929:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167ab41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065928832:0@lo:400:kworker.0 00000100:00100000:3.0:1787381448.012959:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381448.012991:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065928704 00000100:00100000:3.0:1787381448.013215:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065928704 00000100:00100000:3.0:1787381448.013267:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065928320 00000100:00100000:3.0:1787381448.013270:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065928320 00000100:00100000:3.0:1787381448.013291:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787381448.013298:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a33d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874205065928704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787381448.013352:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a33d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874205065928704:12345-0@lo:400:kworker.0 Request processed in 54us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381448.013366:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1787381448.013387:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787381448.013394:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a33c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874205065928320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787381448.013423:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a33c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874205065928320:12345-0@lo:400:kworker.0 Request processed in 30us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381448.013429:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:3.0:1787381448.013451:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787381448.013471:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167ab42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874205065928320:0@lo:400:kworker.0 00000100:00100000:3.0:1787381448.013482:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167ab42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1874205065928704:0@lo:400:kworker.0 00000100:00100000:3.0:1787381448.013584:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065928576 00000100:00100000:3.0:1787381448.013588:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065928576 00000100:00100000:3.0:1787381448.013619:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065928832 00000100:00100000:2.0:1787381448.013890:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787381448.013900:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167ab40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1874205065928576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381448.013939:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167ab40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1874205065928576:12345-0@lo:400:kworker.0 Request processed in 41us (1420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381448.013945:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787381448.014032:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a529880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065928960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787381448.014061:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381448.015071:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065928960 00000100:00100000:2.0:1787381448.015080:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065928960 00000100:00100000:2.0:1787381448.015117:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787381448.015125:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874205065928960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787381448.015153:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787381448.015203:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874205065928960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381448.015211:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787381448.015258:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a529880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065928960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787381448.015306:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381448.015346:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167ab40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065928576:0@lo:400:kworker.0 00000100:00100000:2.0:1787381448.015367:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065928448 00000100:00100000:2.0:1787381448.015370:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065928448 00000100:00100000:2.0:1787381448.015411:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787381448.015428:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874205065928448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381448.015498:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874205065928448:12345-0@lo:400:kworker.0 Request processed in 70us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381448.015504:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787381448.015557:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167ab41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1874205065928448:0@lo:400:kworker.0 00000100:00100000:3.0:1787381448.015848:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065928832 00000100:00100000:3.0:1787381448.015882:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787381448.015890:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a33dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065928832:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787381448.015907:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787381448.015912:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787381448.015915:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787381448.015937:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a33dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065928832:12345-0@lo:400:kworker.0 Request processed in 48us (2978us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381448.015945:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1787381448.015957:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167ab41f80 x1874205065928832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787381464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787381448.015969:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167ab41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065928832:0@lo:400:kworker.0 00000001:00080000:2.0:1787381448.056836:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:1.0:1787381448.524334:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787381448.524369:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065929088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787381448.524447:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381448.524643:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065929088 00000100:00100000:3.0:1787381448.524653:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065929088 00000100:00100000:3.0:1787381448.524761:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787381448.524771:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f930380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065929088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787381448.524805:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787381448.524853:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f930380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065929088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381448.524889:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1787381448.525029:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a166f931180 x1874205065929088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381464 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381448.525048:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065929088:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787381448.588928:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381449.612550:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787381449.866476:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381449.866528:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381449.866620:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381449.866654:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381449.866683:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047020544 00000100:00100000:3.0:1787381449.866691:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047020544 00000100:00100000:3.0:1787381449.866738:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 277 00000100:00100000:3.0:1787381449.866747:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2349:x1874205047020544:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381449.866813:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2349:x1874205047020544:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 67us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381449.866821:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 277 00000100:00100000:3.0:1787381449.866868:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047020800 00000100:00100000:3.0:1787381449.866872:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047020800 00000100:00100000:3.0:1787381449.866905:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 53 00000100:00100000:3.0:1787381449.866912:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+5:2349:x1874205047020800:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381449.866940:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a800000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+5:2349:x1874205047020800:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 28us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381449.866946:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 53 00000100:00080000:3.0:1787381449.866967:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787381449.869341:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047020672 00000100:00100000:2.0:1787381449.869356:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047020672 00000100:00100000:2.0:1787381449.869432:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047020928 00000100:00100000:2.0:1787381449.869436:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047020928 00000100:00100000:1.0:1787381449.869444:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 107 00000100:00100000:1.0:1787381449.869455:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a33f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+5:2349:x1874205047020672:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787381449.869462:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 108 00000100:00100000:2.0:1787381449.869467:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a802680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2349:x1874205047020928:12345-192.168.203.22@tcp:400:kworker.0 00000100:00080000:3.0:1787381449.869656:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787381449.869711:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a802680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2349:x1874205047020928:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 241us (3182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381449.869711:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a33f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+5:2349:x1874205047020672:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 256us (3244us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381449.869719:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 107 00000100:00100000:2.0:1787381449.874739:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 108 00010000:00010000:1.0:1787381450.637459:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381451.660149:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381452.684802:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787381453.132288:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166fb27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065929216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787381453.132382:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381453.132684:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065929216 00000100:00100000:2.0:1787381453.132692:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065929216 00000100:00100000:2.0:1787381453.132751:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787381453.132761:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065929216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787381453.132808:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787381453.132881:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065929216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381453.132889:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1787381453.133749:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787381453.133796:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1787381453.133803:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a167ab40380, transno 4294967300 00000100:00100000:3.0:1787381453.133847:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166fb27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065929216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787381453.135793:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a800a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1874205065929600:0@lo:400:kworker.0 00000100:00100000:1.0:1787381453.136475:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd19486c-5291-4823-bb9c-f3a73416a496:3309:1874205065929344:0@lo:400:kworker.0 00000100:00100000:0.0:1787381453.136603:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a802300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874205065929472:0@lo:400:kworker.0 00000100:00100000:2.0:1787381453.138768:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1874205065929728:0@lo:400:kworker.0 00000100:00100000:1.0:1787381453.142840:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381453.142909:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065929856:0@lo:400:kworker.0 00000100:00100000:1.0:1787381453.142951:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381453.142996:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065929856 00000100:00100000:1.0:1787381453.143020:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065929856 00000100:00100000:1.0:1787381453.143073:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787381453.143082:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f932680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065929856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381453.143135:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f932680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065929856:12345-0@lo:400:kworker.0 Request processed in 53us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381453.143154:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1787381453.144880:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787381453.144924:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a16461ece00 x1874205065929856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787381469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381453.144940:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065929856:0@lo:400:kworker.0 00000100:00100000:3.0:1787381453.148561:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381453.148622:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065929600 00000100:00100000:3.0:1787381453.148631:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065929600 00000100:00100000:3.0:1787381453.149556:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787381453.149569:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16461ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874205065929600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787381453.149638:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16461ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874205065929600:12345-0@lo:400:kworker.0 Request processed in 73us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381453.149645:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:3.0:1787381453.149731:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787381453.149767:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a800a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1874205065929600:0@lo:400:kworker.0 00000100:00100000:0.0:1787381453.150363:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065929344 00000100:00100000:0.0:1787381453.150371:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065929344 00000100:00100000:0.0:1787381453.150406:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787381453.150415:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+19:3309:x1874205065929344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381453.150480:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+19:3309:x1874205065929344:12345-0@lo:400:kworker.0 Request processed in 67us (7660us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381453.150487:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787381453.150531:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a803b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd19486c-5291-4823-bb9c-f3a73416a496:3309:1874205065929344:0@lo:400:kworker.0 00000100:00100000:0.0:1787381453.150562:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381453.150589:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065929472 00000100:00100000:0.0:1787381453.150593:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065929472 00000100:00100000:0.0:1787381453.150618:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787381453.150625:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167ab43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874205065929472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381453.150661:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167ab43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874205065929472:12345-0@lo:400:kworker.0 Request processed in 37us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381453.150669:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787381453.150723:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a802300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874205065929472:0@lo:400:kworker.0 00000100:00100000:2.0:1787381453.151469:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381453.151605:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065929728 00000100:00100000:3.0:1787381453.151615:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065929728 00000100:00100000:3.0:1787381453.151670:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787381453.151677:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fb26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874205065929728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787381453.151728:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fb26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874205065929728:12345-0@lo:400:kworker.0 Request processed in 52us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381453.151737:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787381453.151766:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1874205065929728:0@lo:400:kworker.0 00000100:00080000:1.0:1787381453.151883:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787381453.644728:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787381453.644753:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065929984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787381453.644820:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381453.644958:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065929984 00000100:00100000:1.0:1787381453.644968:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065929984 00000100:00100000:1.0:1787381453.645044:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787381453.645055:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fb24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065929984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787381453.645090:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787381453.645144:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fb24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065929984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381453.645152:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1787381453.645203:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a166f931500 x1874205065929984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381469 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787381453.645221:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065929984:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787381453.708244:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381454.732207:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787381454.860776:0:11528:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787381454.984353:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381454.984393:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381454.984422:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381454.984466:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381454.984532:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047021184 00000100:00100000:0.0:1787381454.984542:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047021184 00000100:00100000:0.0:1787381454.984604:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047021440 00000100:00100000:0.0:1787381454.984608:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047021440 00000100:00100000:0.0:1787381454.984635:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 112 00000100:00100000:0.0:1787381454.984645:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f930000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+5:2349:x1874205047021184:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787381454.984741:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f930000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+5:2349:x1874205047021184:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 97us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381454.984748:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 112 00000100:00100000:0.0:1787381454.984765:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 113 00000100:00100000:0.0:1787381454.984771:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f932300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2349:x1874205047021440:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787381454.984801:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f932300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2349:x1874205047021440:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 31us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381454.984808:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 113 00000100:00100000:2.0:1787381454.985197:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047021056 00000100:00100000:2.0:1787381454.985203:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047021056 00000100:00100000:2.0:1787381454.985241:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 279 00000100:00100000:2.0:1787381454.985248:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2349:x1874205047021056:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787381454.985294:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2349:x1874205047021056:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 47us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381454.985301:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 279 00000100:00080000:1.0:1787381454.985396:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787381454.985660:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047021312 00000100:00100000:3.0:1787381454.985665:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047021312 00000100:00080000:1.0:1787381454.985801:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787381454.987255:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:3.0:1787381454.987270:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f931500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+5:2349:x1874205047021312:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381454.987361:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f931500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+5:2349:x1874205047021312:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 95us (2892us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381454.987369:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 55 00010000:00010000:2.0:1787381455.756133:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381456.780660:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381457.804977:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787381458.252723:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166fb27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065930496:0@lo:400:kworker.0 00000100:00100000:2.0:1787381458.252792:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381458.252858:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787381458.252865:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166fb24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd19486c-5291-4823-bb9c-f3a73416a496:3310:1874205065930112:0@lo:400:kworker.0 00000100:00100000:2.0:1787381458.252894:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381458.252915:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1874205065930624:0@lo:400:kworker.0 00000100:00100000:2.0:1787381458.252970:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381458.252996:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065930624 00000100:00100000:2.0:1787381458.253025:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065930624 00000100:00100000:1.0:1787381458.253030:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065930496 00000100:00100000:2.0:1787381458.253079:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787381458.253088:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874205065930624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381458.253109:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065930496 00000100:00100000:2.0:1787381458.253141:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a807100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874205065930624:12345-0@lo:400:kworker.0 Request processed in 52us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381458.253150:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787381458.253155:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787381458.253164:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065930496:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787381458.253174:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787381458.253179:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787381458.253210:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065930496:12345-0@lo:400:kworker.0 Request processed in 47us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381458.253212:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a804e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1874205065930624:0@lo:400:kworker.0 00000100:00100000:1.0:1787381458.253226:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787381458.253228:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166fb27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065930496:0@lo:400:kworker.0 00000100:00100000:3.0:1787381458.253601:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065930112 00000100:00100000:3.0:1787381458.253607:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065930112 00000100:00100000:3.0:1787381458.253651:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1787381458.253659:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646168850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+19:3310:x1874205065930112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787381458.253710:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646168850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+19:3310:x1874205065930112:12345-0@lo:400:kworker.0 Request processed in 52us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381458.253716:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1787381458.253912:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166fb25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1874205065930368:0@lo:400:kworker.0 00000100:00100000:0.0:1787381458.253944:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381458.253977:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065930880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787381458.254030:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381458.254093:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065930880 00000100:00100000:3.0:1787381458.254098:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065930880 00000100:00100000:1.0:1787381458.254114:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166fb24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd19486c-5291-4823-bb9c-f3a73416a496:3310:1874205065930112:0@lo:400:kworker.0 00000100:00100000:3.0:1787381458.254127:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787381458.254136:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167ab41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065930880:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787381458.254158:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166fb27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874205065930240:0@lo:400:kworker.0 00002000:00000024:3.0:1787381458.254163:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787381458.254277:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065930368 00000100:00100000:0.0:1787381458.254281:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065930368 00000100:00100000:0.0:1787381458.254312:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787381458.254319:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167ab43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874205065930368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381458.254550:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167ab43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874205065930368:12345-0@lo:400:kworker.0 Request processed in 230us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381458.254557:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787381458.254590:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166fb25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1874205065930368:0@lo:400:kworker.0 00000100:00100000:3.0:1787381458.255072:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167ab41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065930880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 936us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381458.255081:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787381458.255123:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065930880:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787381458.255580:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787381458.261210:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381458.261246:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065930240 00000100:00100000:1.0:1787381458.261266:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065930752:0@lo:400:kworker.0 00000100:00100000:0.0:1787381458.261267:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065930240 00000100:00100000:0.0:1787381458.261356:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787381458.261365:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f930e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874205065930240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381458.261447:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f930e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874205065930240:12345-0@lo:400:kworker.0 Request processed in 84us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381458.261455:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787381458.261997:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381458.262160:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166fb27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874205065930240:0@lo:400:kworker.0 00000100:00100000:0.0:1787381458.262522:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065930752 00000100:00100000:0.0:1787381458.262529:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065930752 00000100:00100000:0.0:1787381458.262620:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787381458.262637:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f932a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065930752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381458.262686:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f932a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065930752:12345-0@lo:400:kworker.0 Request processed in 51us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381458.262693:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1787381458.262827:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787381458.262843:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a804000 x1874205065930752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787381474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381458.262855:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a804000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065930752:0@lo:400:kworker.0 00000100:00100000:3.0:1787381458.764950:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787381458.764970:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065931008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787381458.765341:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381458.765414:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065931008 00000100:00100000:3.0:1787381458.765689:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065931008 00000100:00100000:3.0:1787381458.765989:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787381458.765998:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16461ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065931008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787381458.766063:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787381458.766115:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16461ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065931008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381458.766122:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1787381458.766164:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a16461edc00 x1874205065931008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381474 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787381458.766181:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065931008:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787381458.831455:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381459.852295:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787381460.106843:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381460.106960:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381460.108232:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047021696 00000100:00100000:3.0:1787381460.108257:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047021696 00000100:00100000:3.0:1787381460.108349:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 117 00000100:00100000:3.0:1787381460.108361:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167ab40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+5:2351:x1874205047021696:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381460.108457:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167ab40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+5:2351:x1874205047021696:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 98us (1496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381460.108465:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 117 00000100:00080000:0.0:1787381460.108636:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787381460.111188:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047021568 00000100:00100000:2.0:1787381460.111202:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047021568 00000100:00100000:2.0:1787381460.111278:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 281 00000100:00100000:2.0:1787381460.111288:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2351:x1874205047021568:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787381460.111372:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646168450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2351:x1874205047021568:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 85us (4539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381460.111380:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 281 00000100:00100000:0.0:1787381460.126895:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381460.126992:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047021824 00000100:00100000:1.0:1787381460.127001:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047021824 00000100:00100000:1.0:1787381460.127108:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:1.0:1787381460.127118:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167ab41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2157c09-10df-40cb-8228-ad4822122c97+5:2348:x1874205047021824:12345-192.168.203.22@tcp:9:kworker.0 00000020:00000080:1.0:1787381460.127150:0:6587:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbdc38ada7ea0faea 00000100:00080000:1.0:1787381460.127158:0:6587:0:(import.c:65:import_set_state_nolock()) ffff9a167f6ee000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787381460.127202:0:6587:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1787381460.127472:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167ab41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2157c09-10df-40cb-8228-ad4822122c97+2:2348:x1874205047021824:12345-192.168.203.22@tcp:9:kworker.0 Request processed in 354us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381460.127479:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 19 00010000:00010000:3.0:1787381460.127682:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787381460.127991:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787381460.128285:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381460.129674:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047021952 00000100:00100000:0.0:1787381460.129685:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047021952 00000100:00100000:0.0:1787381460.129808:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 118 00000100:00100000:0.0:1787381460.129817:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f933b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2351:x1874205047021952:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787381460.129893:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f933b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2351:x1874205047021952:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 77us (1610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381460.129900:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 118 00000100:00080000:2.0:1787381460.130855:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787381460.876315:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381461.900219:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381462.924350:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787381463.372280:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065931136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787381463.372356:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381463.372476:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065931136 00000100:00100000:1.0:1787381463.372498:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065931136 00000100:00100000:1.0:1787381463.372560:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787381463.372569:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16461edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065931136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787381463.372603:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787381463.372647:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16461edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065931136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381463.372654:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1787381463.372719:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787381463.372760:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065931136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787381463.381310:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1874205065931520:0@lo:400:kworker.0 00000100:00100000:0.0:1787381463.381380:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381463.382576:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787381463.382591:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1874205065931648:0@lo:400:kworker.0 00000100:00100000:0.0:1787381463.382648:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381463.382685:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065931520 00000100:00100000:0.0:1787381463.382691:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065931520 00000100:00100000:0.0:1787381463.382739:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065931648 00000100:00100000:0.0:1787381463.382742:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065931648 00000100:00100000:1.0:1787381463.382758:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1787381463.382843:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065931264:0@lo:400:kworker.0 00000100:00100000:2.0:1787381463.382901:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381463.382929:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1644e1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065931776:0@lo:400:kworker.0 00000100:00100000:2.0:1787381463.382953:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381463.382975:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787381463.382981:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f931f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874205065931392:0@lo:400:kworker.0 00000100:00100000:2.0:1787381463.383029:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381463.383056:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065931264 00000100:00100000:2.0:1787381463.383060:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065931264 00000100:00100000:2.0:1787381463.383087:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1787381463.383094:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+19:3308:x1874205065931264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381463.383143:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+19:3308:x1874205065931264:12345-0@lo:400:kworker.0 Request processed in 49us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381463.383151:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1787381463.383182:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065931776 00000100:00100000:2.0:1787381463.383186:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065931776 00000100:00100000:2.0:1787381463.383212:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787381463.383218:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065931776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381463.383261:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a804e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065931776:12345-0@lo:400:kworker.0 Request processed in 43us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381463.383267:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787381463.383283:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065931392 00000100:00100000:2.0:1787381463.383286:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065931392 00000100:00080000:3.0:1787381463.383569:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787381463.383576:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787381463.383690:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167ab41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874205065931520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381463.383704:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787381463.383715:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167ab40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874205065931648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381463.383746:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167ab41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874205065931520:12345-0@lo:400:kworker.0 Request processed in 61us (2365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381463.383755:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787381463.383762:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167ab40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874205065931648:12345-0@lo:400:kworker.0 Request processed in 49us (1112us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381463.383771:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787381463.383804:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1874205065931648:0@lo:400:kworker.0 00000100:00100000:1.0:1787381463.383817:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1874205065931520:0@lo:400:kworker.0 00000100:00100000:3.0:1787381463.385463:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065931264:0@lo:400:kworker.0 00010000:00080000:3.0:1787381463.385487:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a1644e1d180 x1874205065931776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787381479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787381463.385511:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1644e1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065931776:0@lo:400:kworker.0 00000100:00100000:2.0:1787381463.396406:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787381463.396430:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874205065931392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381463.396537:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a806300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874205065931392:12345-0@lo:400:kworker.0 Request processed in 120us (13506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381463.396560:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787381463.396608:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f931f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874205065931392:0@lo:400:kworker.0 00000001:00100000:2.0:1787381463.473789:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f2157c09-10df-40cb-8228-ad4822122c97 00000020:00000080:2.0:1787381463.473797:0:6614:0:(genops.c:906:class_export_put()) final put ffff9a167f6e9800/f2157c09-10df-40cb-8228-ad4822122c97 00000020:00000080:2.0:1787381463.473822:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9a167f6e9800/f2157c09-10df-40cb-8228-ad4822122c97 for lustre-OST0000 00000020:00000080:2.0:1787381463.473874:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a167f6ee000 for lustre-OST0000 00000100:00100000:1.0:1787381463.884300:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787381463.884325:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065931904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787381463.884397:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381463.884505:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065931904 00000100:00100000:3.0:1787381463.884515:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065931904 00000100:00100000:3.0:1787381463.884575:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787381463.884586:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1644e1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065931904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787381463.884738:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787381463.884798:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1644e1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065931904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 213us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381463.884806:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1787381463.884883:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a16461eed80 x1874205065931904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381479 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381463.884902:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065931904:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787381463.949742:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787381464.076764:0:11528:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787381464.981022:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787381465.224980:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381465.225119:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381465.225152:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381465.225198:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047022080 00000100:00100000:3.0:1787381465.225219:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047022080 00000100:00100000:3.0:1787381465.225273:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 283 00000100:00100000:3.0:1787381465.225282:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2351:x1874205047022080:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381465.225354:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2351:x1874205047022080:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 73us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381465.225363:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 283 00000100:00100000:2.0:1787381465.231996:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047022208 00000100:00100000:2.0:1787381465.232026:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047022208 00000100:00100000:0.0:1787381465.233998:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047022336 00000100:00100000:0.0:1787381465.234022:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047022336 00000100:00100000:0.0:1787381465.234129:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 122 00000100:00100000:0.0:1787381465.234142:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1644e1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2351:x1874205047022336:12345-192.168.203.22@tcp:400:kworker.0 00000100:00080000:2.0:1787381465.234486:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787381465.236749:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 123 00000100:00100000:3.0:1787381465.236763:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1644e1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+5:2351:x1874205047022208:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787381465.237069:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1644e1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2351:x1874205047022336:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 2930us (11914us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381465.237079:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 122 00000100:00100000:3.0:1787381465.237348:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1644e1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+5:2351:x1874205047022208:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 587us (12378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381465.237355:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 123 00000100:00080000:2.0:1787381465.237499:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787381466.006442:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787381466.588711:0:11691:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 02:51:04 (1787381464) 00010000:00010000:2.0:1787381467.020610:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787381467.965989:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381467.966088:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047022464 00000100:00100000:2.0:1787381467.966100:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047022464 00000100:00100000:2.0:1787381467.966207:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 32 00000100:00100000:2.0:1787381467.966221:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16461eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+5:10198:x1874205047022464:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787381467.966248:0:11324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381467.966276:0:11324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fbb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9536f6 expref: -99 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381467.966355:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fbbc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381467.966371:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fbbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381467.966387:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fbbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787381467.966642:0:11324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787381467.966647:0:11324:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787381467.966746:0:11324:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fbbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381467.966775:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fbb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536f6 expref: 7 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381467.966794:0:11324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fbbc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536f6 expref: 6 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381467.966804:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1650b8fd00) 00010000:00010000:2.0:1787381467.966808:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787381467.966812:0:11324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1681732800, rc 0) 00000100:00080000:3.0:1787381467.966963:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787381467.967131:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16461eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+6:10198:x1874205047022464:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 914us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381467.967139:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 32 00000100:00100000:0.0:1787381467.974395:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381467.974496:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047022592 00000100:00100000:2.0:1787381467.974506:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047022592 00000100:00100000:2.0:1787381467.974756:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 33 00000100:00100000:2.0:1787381467.974768:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167ab42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+6:10199:x1874205047022592:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787381467.974799:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381467.974838:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fbc3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9536fd expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381467.974922:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0fbca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381467.974953:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0fbca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381467.974965:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0fbca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381467.974991:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0fbd1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381467.974998:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0fbd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381467.975044:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0fbd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381467.975529:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733a00/0xbdc38ada7ea0fbd8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381467.975552:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733a00/0xbdc38ada7ea0fbd8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381467.975560:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733a00/0xbdc38ada7ea0fbd8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787381467.975641:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787381467.975957:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787381467.976089:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733a00/0xbdc38ada7ea0fbd8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381467.976103:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0fbca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381467.976122:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0fbca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381467.976129:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0fbca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381467.976135:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681733400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381467.976140:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0fbca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381467.976146:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0fbca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381467.976159:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1650b8fd00) 00010000:00010000:2.0:1787381467.976162:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381467.976166:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0fbca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381467.976172:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0fbca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381467.976184:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0fbd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381467.976201:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0fbd1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381467.976208:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0fbd1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381467.976212:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681733200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381467.976221:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0fbd1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381467.976226:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0fbd1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381467.976234:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9a1650b8f800) 00010000:00010000:2.0:1787381467.976236:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381467.976238:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0fbd1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381467.976244:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0fbd1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381467.976297:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fbc3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536fd expref: 8 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381467.976313:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733a00/0xbdc38ada7ea0fbd8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536fd expref: 7 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381467.976319:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a1650b8f400) 00010000:00010000:2.0:1787381467.976321:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787381467.976323:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1681733a00, rc 0) 00000100:00100000:2.0:1787381467.976401:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167ab42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+7:10199:x1874205047022592:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 1635us (2029us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381467.976410:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 33 00000100:00100000:1.0:1787381467.983133:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381467.983244:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047022848 00000100:00100000:3.0:1787381467.983263:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047022848 00000100:00100000:3.0:1787381467.983323:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 34 00000100:00100000:3.0:1787381467.983334:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1644e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+7:10199:x1874205047022848:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787381467.983354:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381467.983373:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea0fbdf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953704 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381467.983455:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea0fbe6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381467.983468:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea0fbe6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381467.983479:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea0fbe6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381467.983493:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea0fbed lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381467.983498:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea0fbed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381467.983504:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea0fbed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381467.984061:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0e00/0xbdc38ada7ea0fbf4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381467.984072:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0e00/0xbdc38ada7ea0fbf4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381467.984079:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0e00/0xbdc38ada7ea0fbf4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787381467.984094:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787381467.984311:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea0fbe6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381467.984319:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea0fbe6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381467.984325:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea0fbe6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381467.984331:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb0800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381467.984336:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea0fbe6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381467.984343:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea0fbe6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381467.984355:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a1650b8f400) 00010000:00010000:3.0:1787381467.984358:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381467.984362:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea0fbe6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381467.984369:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea0fbe6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381467.984380:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea0fbed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381467.984386:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea0fbed lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381467.984402:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea0fbed lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381467.984419:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb1200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381467.984423:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea0fbed lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381467.984430:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea0fbed lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381467.984439:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a1643052a00) 00010000:00010000:3.0:1787381467.984441:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381467.984444:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea0fbed lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381467.984449:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea0fbed lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381467.984812:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea0fbdf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953704 expref: 10 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381467.984826:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0e00/0xbdc38ada7ea0fbf4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953704 expref: 9 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381467.984834:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a1643052000) 00010000:00010000:3.0:1787381467.984836:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381467.984839:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb0e00, rc 0) 00000100:00100000:3.0:1787381467.984911:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1644e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+9:10199:x1874205047022848:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 1578us (1787us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787381467.984932:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 34 00000100:00100000:3.0:1787381467.989895:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381467.990221:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047022976 00000100:00100000:2.0:1787381467.990277:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047022976 00000100:00100000:2.0:1787381467.990344:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 35 00000100:00100000:2.0:1787381467.990354:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16461eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+9:10199:x1874205047022976:12345-192.168.203.22@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787381467.990500:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16461eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+9:10199:x1874205047022976:12345-192.168.203.22@tcp:59:lhsmtool_posix.0 Request processed in 146us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381467.990508:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 35 00010000:00010000:1.0:1787381468.045877:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787381468.172668:0:11528:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787381468.492401:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1644e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065932032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787381468.492508:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381468.492603:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065932032 00000100:00100000:1.0:1787381468.492613:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065932032 00000100:00100000:1.0:1787381468.492681:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787381468.492704:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1644e1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065932032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787381468.492752:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787381468.492801:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1644e1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065932032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381468.492808:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1787381468.492832:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787381468.492875:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1644e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065932032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787381468.515340:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787381468.515380:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167ab42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd19486c-5291-4823-bb9c-f3a73416a496:3310:1874205065932160:0@lo:400:kworker.0 00000100:00100000:0.0:1787381468.515491:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381468.515572:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065932160 00000100:00100000:0.0:1787381468.515581:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065932160 00000100:00100000:0.0:1787381468.515643:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787381468.515653:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+19:3310:x1874205065932160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381468.515714:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646169050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+19:3310:x1874205065932160:12345-0@lo:400:kworker.0 Request processed in 62us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381468.515737:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1787381468.515798:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167ab42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd19486c-5291-4823-bb9c-f3a73416a496:3310:1874205065932160:0@lo:400:kworker.0 00000100:00100000:0.0:1787381468.515860:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167ab42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874205065932288:0@lo:400:kworker.0 00000100:00100000:0.0:1787381468.515891:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381468.515928:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065932288 00000100:00100000:0.0:1787381468.515932:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065932288 00000100:00100000:0.0:1787381468.515961:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787381468.515968:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167ab42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874205065932288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381468.516001:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167ab42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874205065932288:12345-0@lo:400:kworker.0 Request processed in 34us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381468.516042:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787381468.516074:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167ab42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874205065932288:0@lo:400:kworker.0 00000100:00100000:0.0:1787381468.516105:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167ab42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1874205065932416:0@lo:400:kworker.0 00000100:00100000:0.0:1787381468.516130:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381468.516162:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065932416 00000100:00100000:0.0:1787381468.516165:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065932416 00000100:00100000:0.0:1787381468.516216:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787381468.516222:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167ab41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874205065932416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381468.516256:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167ab41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874205065932416:12345-0@lo:400:kworker.0 Request processed in 34us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381468.516262:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787381468.516291:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167ab42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1874205065932416:0@lo:400:kworker.0 00000100:00080000:0.0:1787381468.516308:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787381468.516333:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167ab42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1874205065932544:0@lo:400:kworker.0 00000100:00100000:0.0:1787381468.516364:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381468.516392:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065932544 00000100:00100000:0.0:1787381468.516396:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065932544 00000100:00100000:0.0:1787381468.516421:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787381468.516427:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167ab42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874205065932544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381468.516461:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167ab42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874205065932544:12345-0@lo:400:kworker.0 Request processed in 33us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381468.516467:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:0.0:1787381468.516482:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787381468.516497:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167ab42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1874205065932544:0@lo:400:kworker.0 00000100:00100000:0.0:1787381468.516525:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787381468.516531:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167ab42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065932672:0@lo:400:kworker.0 00000100:00100000:0.0:1787381468.516558:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381468.516586:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065932672 00000100:00100000:0.0:1787381468.516590:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065932672 00000100:00100000:0.0:1787381468.516624:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787381468.516630:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167ab43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065932672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381468.516662:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167ab43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065932672:12345-0@lo:400:kworker.0 Request processed in 33us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381468.516668:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1787381468.516682:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787381468.516697:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167ab42680 x1874205065932672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787381484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381468.516707:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167ab42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065932672:0@lo:400:kworker.0 00000001:00080000:2.0:1787381468.542595:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000100:00100000:3.0:1787381469.004523:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787381469.004557:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16461ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065932800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787381469.004662:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381469.008952:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065932800 00000100:00100000:1.0:1787381469.008974:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065932800 00000100:00100000:1.0:1787381469.009223:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787381469.009235:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065932800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787381469.009295:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787381469.009490:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065932800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 257us (4828us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381469.009499:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1787381469.009598:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a16461ece00 x1874205065932800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381485 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381469.009641:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16461ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065932800:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787381469.068127:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787381470.065282:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381470.065413:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047023104 00000100:00100000:0.0:1787381470.065423:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047023104 00000100:00100000:0.0:1787381470.065511:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 36 00000100:00100000:0.0:1787381470.065522:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1644e1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+8:10241:x1874205047023104:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1787381470.065544:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381470.065566:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8c00/0xbdc38ada7ea0fc02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a95370b expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787381470.065573:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787381470.065627:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8600/0xbdc38ada7ea0fc09 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.065641:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8600/0xbdc38ada7ea0fc09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.065655:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8600/0xbdc38ada7ea0fc09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.065668:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea0fc10 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.065675:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea0fc10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.065680:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea0fc10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.065957:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8600/0xbdc38ada7ea0fc09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.065974:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8600/0xbdc38ada7ea0fc09 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.065980:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8600/0xbdc38ada7ea0fc09 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.065985:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c8600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787381470.065989:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8600/0xbdc38ada7ea0fc09 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.065996:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8600/0xbdc38ada7ea0fc09 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.066031:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1650b8fd00) 00010000:00010000:0.0:1787381470.066034:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787381470.066038:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8600/0xbdc38ada7ea0fc09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.066043:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8600/0xbdc38ada7ea0fc09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.066055:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea0fc10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.066060:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea0fc10 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.066065:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea0fc10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.066069:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c9400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787381470.066077:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea0fc10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.066083:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea0fc10 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.066090:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9a1643af1b00) 00010000:00010000:0.0:1787381470.066093:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787381470.066095:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea0fc10 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.066102:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea0fc10 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.066141:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8c00/0xbdc38ada7ea0fc02 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95370b expref: 9 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.066151:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1650b8fd00) 00010000:00010000:0.0:1787381470.066153:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787381470.066156:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8c00/0xbdc38ada7ea0fc02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95370b expref: 9 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.066165:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16460c8c00, rc 0) 00000100:00100000:0.0:1787381470.066237:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1644e1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+8:10241:x1874205047023104:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 717us (964us total) trans 0 rc 301/301 00000100:00100000:0.0:1787381470.066245:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 36 00000100:00100000:1.0:1787381470.076708:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381470.079734:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047023360 00000100:00100000:0.0:1787381470.079752:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047023360 00000100:00100000:0.0:1787381470.079981:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 37 00000100:00100000:0.0:1787381470.079992:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1644e1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+8:10241:x1874205047023360:12345-192.168.203.22@tcp:36:lfs.0 00010000:00010000:0.0:1787381470.080080:0:11324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787381470.080116:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fbbc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536f6 expref: 8 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.080134:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1650b8fd00) 00010000:00010000:0.0:1787381470.080144:0:11324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787381470.080569:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8c00/0xbdc38ada7ea0fc17 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.080583:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8c00/0xbdc38ada7ea0fc17 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.080595:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8c00/0xbdc38ada7ea0fc17 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.080608:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea0fc1e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.080615:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea0fc1e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.080621:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea0fc1e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787381470.086813:0:11324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787381470.086838:0:11324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8c00/0xbdc38ada7ea0fc17 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.086849:0:11324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8c00/0xbdc38ada7ea0fc17 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.086856:0:11324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8c00/0xbdc38ada7ea0fc17 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.086870:0:11324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c8c00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787381470.087033:0:11324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8c00/0xbdc38ada7ea0fc17 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.087042:0:11324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8c00/0xbdc38ada7ea0fc17 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.087059:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1643af1b00) 00010000:00010000:0.0:1787381470.087062:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787381470.087066:0:11324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8c00/0xbdc38ada7ea0fc17 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.087073:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8c00/0xbdc38ada7ea0fc17 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787381470.087092:0:11324:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f5797c40 reply state 00000000ae5d8cc0 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea0fc1e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381470.087102:0:11324:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787381470.087251:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1644e1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+9:10241:x1874205047023360:12345-192.168.203.22@tcp:36:lfs.0 Request processed in 7257us (10547us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787381470.087259:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 37 00010000:00010000:1.0:1787381470.098251:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381470.101830:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea0fc1e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.101848:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea0fc1e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.101857:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea0fc1e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.101864:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c9400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381470.101884:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea0fc1e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.101893:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea0fc1e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.101912:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9a1643af1500) 00010000:00010000:3.0:1787381470.101915:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381470.101921:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea0fc1e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.102509:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea0fc1e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381470.190614:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381470.190844:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047023488 00000100:00100000:0.0:1787381470.190855:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047023488 00000100:00100000:0.0:1787381470.190920:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 38 00000100:00100000:0.0:1787381470.190931:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1644e1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+8:10249:x1874205047023488:12345-192.168.203.22@tcp:101:lctl.0 00010000:00010000:0.0:1787381470.190958:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381470.190981:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8c00/0xbdc38ada7ea0fc25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953712 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.191968:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea0fc2c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.191984:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea0fc2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.191996:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea0fc2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787381470.192376:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787381470.192383:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787381470.192428:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea0fc2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.192459:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8c00/0xbdc38ada7ea0fc25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953712 expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.192483:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea0fc2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953712 expref: 9 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.192492:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1643af1b00) 00010000:00010000:2.0:1787381470.192494:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787381470.192498:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1681732000, rc 0) 00000100:00100000:2.0:1787381470.192574:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1644e1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+9:10249:x1874205047023488:12345-192.168.203.22@tcp:101:lctl.0 Request processed in 1645us (1971us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381470.192595:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 38 00000100:00100000:1.0:1787381470.258975:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381470.259254:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047023616 00000100:00100000:3.0:1787381470.259278:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047023616 00000100:00100000:3.0:1787381470.259332:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00100000:3.0:1787381470.259349:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1644e1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+9:10255:x1874205047023616:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:3.0:1787381470.259370:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381470.259388:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea0fc33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953719 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.259463:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea0fc3a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.259476:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea0fc3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.259487:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea0fc3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.259501:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea0fc41 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.259507:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea0fc41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.259513:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea0fc41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.259619:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1e00/0xbdc38ada7ea0fc48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.259627:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1e00/0xbdc38ada7ea0fc48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.259634:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1e00/0xbdc38ada7ea0fc48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787381470.259670:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1787381470.259673:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787381470.260855:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1e00/0xbdc38ada7ea0fc48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.260875:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea0fc3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.260882:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea0fc3a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.260890:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea0fc3a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.260895:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb1200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381470.260899:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea0fc3a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.260906:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea0fc3a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.260919:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1643af1b00) 00010000:00010000:2.0:1787381470.260922:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381470.260927:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea0fc3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.260933:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea0fc3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.260947:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea0fc41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.260954:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea0fc41 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.260971:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea0fc41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.260977:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb0800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381470.260980:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea0fc41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.260987:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea0fc41 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.261419:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9a1643052200) 00010000:00010000:2.0:1787381470.261432:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381470.261436:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea0fc41 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.261443:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea0fc41 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.261507:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea0fc33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953719 expref: 11 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.261523:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1e00/0xbdc38ada7ea0fc48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953719 expref: 10 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.261531:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a1643052a00) 00010000:00010000:2.0:1787381470.261533:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787381470.261536:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb1e00, rc 0) 00000100:00100000:2.0:1787381470.261616:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1644e1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+10:10255:x1874205047023616:12345-192.168.203.22@tcp:101:bash.0 Request processed in 2274us (2650us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381470.261635:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00100000:1.0:1787381470.268559:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381470.269203:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047023872 00000100:00100000:2.0:1787381470.269214:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047023872 00000100:00100000:2.0:1787381470.269286:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 40 00000100:00100000:2.0:1787381470.269297:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1644e1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+10:10255:x1874205047023872:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:2.0:1787381470.269317:0:11324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381470.269347:0:11324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0fc4f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953720 expref: -99 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.269508:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fc56 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.269523:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fc56 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.269534:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fc56 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.269590:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0fc5d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.269598:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0fc5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.269605:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0fc5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787381470.270227:0:11324:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1787381470.270403:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0fc64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.270420:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0fc64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.270428:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0fc64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.270465:0:11324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fc56 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.270472:0:11324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fc56 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.270478:0:11324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fc56 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.270489:0:11324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681732800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381470.270492:0:11324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fc56 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.270499:0:11324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fc56 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.270511:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a1643052a00) 00010000:00010000:2.0:1787381470.270514:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381470.270518:0:11324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fc56 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.270523:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fc56 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787381470.270536:0:11324:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000099c1a66 reply state 0000000025f9ff40 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0fc5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381470.270551:0:11324:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787381470.270589:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0fc4f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953720 expref: 13 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.270604:0:11324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0fc64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953720 expref: 12 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.270611:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1650b8f200) 00010000:00010000:2.0:1787381470.270614:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787381470.270617:0:11324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1681733200, rc 0) 00000100:00100000:2.0:1787381470.270685:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1644e1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+13:10255:x1874205047023872:12345-192.168.203.22@tcp:101:bash.0 Request processed in 1389us (2134us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787381470.270694:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 40 00010000:00010000:2.0:1787381470.273213:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0fc5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.273711:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0fc5d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.273720:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0fc5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.273727:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681733400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381470.273731:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0fc5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.273740:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0fc5d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.273777:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a1650b8f600) 00010000:00010000:2.0:1787381470.273781:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381470.273787:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0fc5d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.273792:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0fc5d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381470.280279:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381470.280405:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047024000 00000100:00100000:2.0:1787381470.280420:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047024000 00000100:00100000:2.0:1787381470.280603:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:2.0:1787381470.280613:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1644e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1874205047024000:12345-192.168.203.22@tcp:8:bash.0 00010000:00080000:2.0:1787381470.280651:0:6590:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from f2157c09-10df-40cb-8228-ad4822122c97@192.168.203.22@tcp t0 exp 0000000000000000 cur 328 last 0 00000020:00000080:2.0:1787381470.280688:0:6590:0:(genops.c:1406:class_connect()) connect: client f2157c09-10df-40cb-8228-ad4822122c97, cookie 0xbdc38ada7ea0fc72 00002000:00100000:2.0:1787381470.280702:0:6590:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f2157c09-10df-40cb-8228-ad4822122c97/ffff9a167533a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113673 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787381470.280712:0:6590:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787381470.280977:0:6590:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787381470.281061:0:6590:0:(import.c:65:import_set_state_nolock()) ffff9a1675339000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787381470.281151:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1644e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2157c09-10df-40cb-8228-ad4822122c97+6:2348:x1874205047024000:12345-192.168.203.22@tcp:8:bash.0 Request processed in 538us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381470.281160:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:1.0:1787381470.286753:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381470.288839:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047024128 00000100:00100000:0.0:1787381470.288862:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047024128 00000100:00100000:0.0:1787381470.289127:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:0.0:1787381470.289141:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1644e1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2157c09-10df-40cb-8228-ad4822122c97+6:0:x1874205047024128:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:0.0:1787381470.289167:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381470.289742:0:6587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec873412/0xbdc38ada7ea0fc79 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953727 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787381470.289787:0:6587:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787381470.289814:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=328s v=(0 0) 00010000:00010000:0.0:1787381470.289819:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381470.289833:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec873412/0xbdc38ada7ea0fc79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953727 expref: 7 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.289859:0:6587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ec873412/0xbdc38ada7ea0fc79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953727 expref: 7 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.289876:0:6587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16460c9800, rc 0) 00000100:00080000:1.0:1787381470.289923:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787381470.290689:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1644e1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2157c09-10df-40cb-8228-ad4822122c97+7:0:x1874205047024128:12345-192.168.203.22@tcp:101:bash.0 Request processed in 1546us (3945us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381470.290701:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:1.0:1787381470.297480:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381470.297565:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047024256 00000100:00100000:3.0:1787381470.297575:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047024256 00000100:00100000:3.0:1787381470.297630:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:3.0:1787381470.297640:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1644e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+7:10255:x1874205047024256:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:3.0:1787381470.297659:0:6588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381470.297678:0:6588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001db63c99/0xbdc38ada7ea0fc80 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a95372e expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.297708:0:6588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ec873412/0xbdc38ada7ea0fc79 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953727 expref: 8 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.297718:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787381470.297722:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787381470.297728:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001db63c99/0xbdc38ada7ea0fc80 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95372e expref: 8 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.297760:0:6588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ec873412/0xbdc38ada7ea0fc79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953727 expref: 8 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.297775:0:6588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ec873412/0xbdc38ada7ea0fc79 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953727 expref: 8 pid: 6587 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381470.297790:0:6588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a803b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6588:1874205065932928:192.168.203.22@tcp:104: 00000100:00100000:3.0:1787381470.297906:0:6588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1665a6b540 going to sleep for 11 seconds 00000100:00100000:0.0:1787381470.301626:0:6588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a803b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6588:1874205065932928:192.168.203.22@tcp:104: 00010000:00010000:0.0:1787381470.301681:0:6588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001db63c99/0xbdc38ada7ea0fc80 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc01952459a95372e expref: 8 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.301744:0:6588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb0600, rc 0) 00000100:00100000:0.0:1787381470.301844:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1644e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+8:10255:x1874205047024256:12345-192.168.203.22@tcp:101:bash.0 Request processed in 4203us (4373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381470.301855:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:1.0:1787381470.304307:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381470.304455:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047024384 00000100:00100000:3.0:1787381470.304465:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047024384 00010000:00010000:3.0:1787381470.304519:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ec873412/0xbdc38ada7ea0fc79 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953727 expref: 8 pid: 6587 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381470.304563:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 35 00000100:00100000:3.0:1787381470.304574:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1644e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2157c09-10df-40cb-8228-ad4822122c97+8:2349:x1874205047024384:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787381470.304591:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787381470.304616:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ec873412/0xbdc38ada7ea0fc79 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953727 expref: 8 pid: 6587 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.304630:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ec873412/0xbdc38ada7ea0fc79 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953727 expref: 8 pid: 6587 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.304659:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec873412/0xbdc38ada7ea0fc79 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953727 expref: 8 pid: 6587 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.304675:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787381470.304680:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787381470.304688:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001db63c99/0xbdc38ada7ea0fc80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.22@tcp remote: 0xc01952459a95372e expref: 7 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.304699:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001db63c99/0xbdc38ada7ea0fc80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.22@tcp remote: 0xc01952459a95372e expref: 7 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.304757:0:5776:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001db63c99/0xbdc38ada7ea0fc80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc01952459a95372e expref: 7 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381470.304771:0:5776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a800a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5776:1874205065933056:192.168.203.22@tcp:105: 00000100:00100000:3.0:1787381470.305163:0:5776:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1665a6b180 going to sleep for 11 seconds 00000100:00100000:3.0:1787381470.309280:0:5776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a800a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5776:1874205065933056:192.168.203.22@tcp:105: 00010000:00010000:3.0:1787381470.309308:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787381470.309377:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1644e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2157c09-10df-40cb-8228-ad4822122c97+7:2349:x1874205047024384:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 4804us (5078us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381470.309388:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 35 00000100:00100000:0.0:1787381470.312551:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381470.313110:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047024640 00000100:00100000:2.0:1787381470.313124:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047024640 00000100:00100000:2.0:1787381470.313204:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:2.0:1787381470.313214:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167ab42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+12:10255:x1874205047024640:12345-192.168.203.22@tcp:35:bash.0 00000100:00100000:2.0:1787381470.313628:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167ab42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+13:10255:x1874205047024640:12345-192.168.203.22@tcp:35:bash.0 Request processed in 414us (1085us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787381470.313643:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:1.0:1787381470.353080:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381470.353141:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381470.353235:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047024896 00000100:00100000:2.0:1787381470.353246:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047024896 00000100:00100000:2.0:1787381470.353335:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 127 00000100:00100000:2.0:1787381470.353354:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1644e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2351:x1874205047024896:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787381470.353432:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1644e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2351:x1874205047024896:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 80us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381470.353440:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 127 00000100:00100000:0.0:1787381470.353698:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047024768 00000100:00100000:0.0:1787381470.353704:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047024768 00000100:00100000:0.0:1787381470.353746:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 285 00000100:00100000:0.0:1787381470.353753:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646168c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2351:x1874205047024768:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787381470.353784:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646168c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2351:x1874205047024768:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 31us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381470.353791:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 285 00000100:00080000:1.0:1787381470.354362:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787381470.430110:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381470.430231:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047025152 00000100:00100000:2.0:1787381470.430241:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047025152 00000100:00100000:2.0:1787381470.430313:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 41 00000100:00100000:2.0:1787381470.430324:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a800a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+13:10266:x1874205047025152:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1787381470.430353:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381470.430376:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0fc87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953735 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787381470.430501:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787381470.430629:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0fc87 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953735 expref: 15 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.430644:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1643af1b00) 00010000:00010000:2.0:1787381470.430646:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787381470.430651:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0fc87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953735 expref: 15 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.430666:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1681733400, rc 0) 00000100:00100000:2.0:1787381470.430747:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a800a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+14:10266:x1874205047025152:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 424us (645us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1787381470.430755:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 41 00000100:00100000:0.0:1787381470.437293:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381470.437450:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047025408 00000100:00100000:2.0:1787381470.437462:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047025408 00000100:00100000:2.0:1787381470.437526:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:2.0:1787381470.437536:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16461ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+14:10266:x1874205047025408:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:2.0:1787381470.437814:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16461ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+15:10266:x1874205047025408:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 278us (531us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787381470.437822:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:1.0:1787381470.553199:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381470.553359:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047025536 00000100:00100000:2.0:1787381470.553371:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047025536 00000100:00100000:2.0:1787381470.553431:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 42 00000100:00100000:2.0:1787381470.553441:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1644e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+15:10272:x1874205047025536:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1787381470.553467:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381470.553489:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0fc95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a95373c expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.553556:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0fc9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.553570:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0fc9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.553583:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0fc9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787381470.553643:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787381470.553655:0:8469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787381470.553889:0:8469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0fc9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.553919:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0fc95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95373c expref: 17 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.553936:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0fc9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95373c expref: 16 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.553943:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a1643052a00) 00010000:00010000:2.0:1787381470.553946:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787381470.553950:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1681733000, rc 0) 00000100:00100000:2.0:1787381470.554036:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1644e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+16:10272:x1874205047025536:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 596us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381470.554044:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 42 00000100:00100000:1.0:1787381470.573893:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381470.574482:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047025792 00000100:00100000:3.0:1787381470.574494:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047025792 00000100:00100000:3.0:1787381470.574567:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 43 00000100:00100000:3.0:1787381470.574578:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1644e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+16:10272:x1874205047025792:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1787381470.574600:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381470.574620:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea0fca3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953743 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.574734:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea0fcaa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.574749:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea0fcaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.574763:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea0fcaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787381470.574802:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787381470.574947:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea0fca3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953743 expref: 19 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.574966:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea0fcaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953743 expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.574974:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1650b8f200) 00010000:00010000:3.0:1787381470.574977:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787381470.574980:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb1400, rc 0) 00000100:00100000:3.0:1787381470.575071:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1644e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+18:10272:x1874205047025792:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 494us (1186us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1787381470.575079:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 43 00000100:00100000:2.0:1787381470.583502:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381470.583590:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047025920 00000100:00100000:3.0:1787381470.583600:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047025920 00000100:00100000:3.0:1787381470.584734:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:3.0:1787381470.584752:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a804380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+18:2350:x1874205047025920:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787381470.584771:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787381470.584797:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea0fcaa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953743 expref: 18 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.584815:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1650b8f200) 00010000:00010000:3.0:1787381470.584820:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787381470.584883:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a804380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+17:2350:x1874205047025920:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 136us (1390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381470.584890:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:1.0:1787381470.587926:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381470.588035:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047026176 00000100:00100000:3.0:1787381470.588045:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047026176 00000100:00100000:3.0:1787381470.588102:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 44 00000100:00100000:3.0:1787381470.588113:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1644e1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+17:10272:x1874205047026176:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1787381470.588138:0:11324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381470.588157:0:11324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea0fcb8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a95374a expref: -99 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.588341:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea0fcbf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.588356:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea0fcbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.588369:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea0fcbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787381470.588382:0:11324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787381470.588515:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea0fcb8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95374a expref: 20 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.588535:0:11324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea0fcbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95374a expref: 19 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.588544:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1650b8f200) 00010000:00010000:3.0:1787381470.588552:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787381470.588556:0:11324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb1a00, rc 0) 00000100:00100000:3.0:1787381470.588624:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1644e1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+19:10272:x1874205047026176:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 513us (706us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787381470.588644:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 44 00000100:00100000:1.0:1787381470.599438:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381470.599480:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047026304 00000100:00100000:1.0:1787381470.599491:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047026304 00000100:00100000:1.0:1787381470.599707:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:1.0:1787381470.599717:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f931f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2157c09-10df-40cb-8228-ad4822122c97+7:2352:x1874205047026304:12345-192.168.203.22@tcp:1:lfs.0 00010000:00010000:1.0:1787381470.599761:0:7779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091b766fa/0xbdc38ada7ea0fccd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381470.599782:0:7779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001db63c99/0xbdc38ada7ea0fc80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc01952459a95372e expref: 7 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381470.599790:0:7779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787381470.599794:0:7779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787381470.599807:0:7779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091b766fa/0xbdc38ada7ea0fccd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381470.599842:0:7779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001db63c99/0xbdc38ada7ea0fc80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.22@tcp remote: 0xc01952459a95372e expref: 7 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381470.599857:0:7779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001db63c99/0xbdc38ada7ea0fc80 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a95372e expref: 7 pid: 6588 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381470.599874:0:7779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f932d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7779:1874205065933184:192.168.203.22@tcp:104: 00000100:00100000:1.0:1787381470.599966:0:7779:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fbac600 going to sleep for 11 seconds 00000100:00100000:0.0:1787381470.605599:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381470.605654:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047026432 00000100:00100000:0.0:1787381470.605663:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047026432 00002000:00100000:0.0:1787381470.605710:0:6593:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9a167a5c8700 x1874205047026432/t0(0) o4->f2157c09-10df-40cb-8228-ad4822122c97@192.168.203.22@tcp:521/0 lens 504/0 e 0 to 0 dl 1787381481 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787381470.605720:0:6593:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a167a5c8700 with x1874205047026432 ext(0->12) 00010000:00010000:0.0:1787381470.605728:0:6593:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001db63c99/0xbdc38ada7ea0fc80 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a95372e expref: 8 pid: 6588 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.605743:0:6593:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001db63c99/0xbdc38ada7ea0fc80 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a95372e expref: 8 pid: 6588 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787381470.605763:0:6593:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a167a5c8700 00000100:00100000:0.0:1787381470.605791:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:0.0:1787381470.605800:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f2157c09-10df-40cb-8228-ad4822122c97+8:2349:x1874205047026432:12345-192.168.203.22@tcp:4:lfs.0 00000100:00100000:3.0:1787381470.606496:0:7779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f932d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7779:1874205065933184:192.168.203.22@tcp:104: 00010000:00010000:3.0:1787381470.606521:0:7779:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000091b766fa/0xbdc38ada7ea0fccd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1787381470.638343:0:7481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f2157c09-10df-40cb-8228-ad4822122c97 00000100:00100000:0.0:1787381470.690573:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f2157c09-10df-40cb-8228-ad4822122c97+9:2349:x1874205047026432:12345-192.168.203.22@tcp:4:lfs.0 Request processed in 84765us (84975us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787381470.690588:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 0 00002000:00100000:0.0:1787381470.690600:0:6593:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9a167a5c8700 x1874205047026432/t4294967299(0) o4->f2157c09-10df-40cb-8228-ad4822122c97@192.168.203.22@tcp:521/0 lens 504/448 e 0 to 0 dl 1787381481 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787381470.690610:0:6593:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a167a5c8700 with x1874205047026432 ext(0->12) 00010000:00010000:0.0:1787381470.690621:0:6593:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001db63c99/0xbdc38ada7ea0fc80 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a95372e expref: 9 pid: 6588 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.690639:0:6593:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001db63c99/0xbdc38ada7ea0fc80 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a95372e expref: 9 pid: 6588 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787381470.690648:0:6593:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a167a5c8700 00000100:00100000:1.0:1787381470.698245:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381470.698549:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047026560 00000100:00100000:3.0:1787381470.698560:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047026560 00010000:00010000:3.0:1787381470.698599:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001db63c99/0xbdc38ada7ea0fc80 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a95372e expref: 9 pid: 6588 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381470.698642:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 36 00000100:00100000:3.0:1787381470.698652:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f931c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2157c09-10df-40cb-8228-ad4822122c97+9:2351:x1874205047026560:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787381470.698668:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787381470.698686:0:5776:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787381470.698689:0:5776:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787381469 00002000:00010000:3.0:1787381470.698692:0:5776:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787381469 00002000:00010000:3.0:1787381470.698694:0:5776:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787381469 00010000:00010000:3.0:1787381470.698701:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001db63c99/0xbdc38ada7ea0fc80 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a95372e expref: 9 pid: 6588 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.698715:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001db63c99/0xbdc38ada7ea0fc80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a95372e expref: 9 pid: 6588 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.698738:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001db63c99/0xbdc38ada7ea0fc80 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a95372e expref: 9 pid: 6588 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.698768:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787381470.698773:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787381470.698778:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000091b766fa/0xbdc38ada7ea0fccd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.698790:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091b766fa/0xbdc38ada7ea0fccd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.698830:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787381470.699803:0:7779:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000091b766fa/0xbdc38ada7ea0fccd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381470.699819:0:7779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091b766fa/0xbdc38ada7ea0fccd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381470.699863:0:7779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091b766fa/0xbdc38ada7ea0fccd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381470.699871:0:7779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091b766fa/0xbdc38ada7ea0fccd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381470.699879:0:7779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091b766fa/0xbdc38ada7ea0fccd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381470.699904:0:7779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541389000 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:1.0:1787381470.699909:0:7779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091b766fa/0xbdc38ada7ea0fccd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381470.699917:0:7779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091b766fa/0xbdc38ada7ea0fccd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381470.699935:0:7779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091b766fa/0xbdc38ada7ea0fccd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381470.699943:0:7779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091b766fa/0xbdc38ada7ea0fccd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381470.700792:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f931f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2157c09-10df-40cb-8228-ad4822122c97+8:2352:x1874205047026304:12345-192.168.203.22@tcp:1:lfs.0 Request processed in 101068us (101357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381470.700804:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:3.0:1787381470.700850:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f931c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2157c09-10df-40cb-8228-ad4822122c97+7:2351:x1874205047026560:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 245us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381470.700860:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 36 00000100:00100000:2.0:1787381470.707636:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381470.707728:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047026816 00000100:00100000:0.0:1787381470.707738:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047026816 00000100:00100000:0.0:1787381470.707791:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:0.0:1787381470.707801:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+19:10272:x1874205047026816:12345-192.168.203.22@tcp:35:lfs.0 00000004:00010000:0.0:1787381470.707993:0:5794:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea0fcbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95374a expref: 19 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787381470.708657:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1787381470.708708:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1787381470.710791:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1787381470.711134:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea0fcd4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.711159:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0fc64 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953720 expref: 23 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.711168:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea0fcd4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.711216:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0fc64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953720 expref: 23 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.711233:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0fc64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953720 expref: 23 pid: 11324 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381470.711248:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a5cb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5794:1874205065933312:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787381470.711540:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f689900 going to sleep for 11 seconds 00000100:00100000:0.0:1787381470.716447:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381470.716583:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047026944 00000100:00100000:3.0:1787381470.716593:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047026944 00010000:00010000:3.0:1787381470.716632:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0fc64 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953720 expref: 24 pid: 11324 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381470.716676:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 37 00000100:00100000:3.0:1787381470.716686:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+24:2350:x1874205047026944:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787381470.716723:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787381470.716732:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0fc64 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953720 expref: 24 pid: 11324 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.716746:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0fc64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953720 expref: 24 pid: 11324 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.716783:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1650b8f200) 00010000:00010000:3.0:1787381470.716788:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea0fcd4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.716799:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea0fcd4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.716808:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea0fcd4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.716827:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787381470.717108:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+24:2350:x1874205047026944:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 351us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381470.717117:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 37 00010000:00010000:2.0:1787381470.718322:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0fc64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953720 expref: 23 pid: 11324 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381470.718344:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a5cb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5794:1874205065933312:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787381470.718365:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea0fcd4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.718373:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea0fcd4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.718378:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea0fcd4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787381470.718537:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1787381470.718729:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1787381470.718835:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166fb27800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5794:1874205065933440:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787381470.718887:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381470.718917:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1646e78180 going to sleep for 11 seconds 00000100:00100000:0.0:1787381470.718950:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065933440 00000100:00100000:0.0:1787381470.718957:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065933440 00000100:00100000:0.0:1787381470.719029:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787381470.719047:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fb25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5794:x1874205065933440:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787381470.719130:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fb25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5794:x1874205065933440:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 92us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381470.719147:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787381470.719780:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166fb27800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5794:1874205065933440:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787381470.721390:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00080000:1.0:1787381470.721484:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787381470.721618:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166fb24000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5794:1874205065933568:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787381470.721685:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381470.721761:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1646e78780 going to sleep for 11 seconds 00000100:00100000:0.0:1787381470.721800:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065933568 00000100:00100000:0.0:1787381470.721809:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065933568 00000100:00100000:0.0:1787381470.721885:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787381470.721911:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fb27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5794:x1874205065933568:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787381470.722275:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fb27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5794:x1874205065933568:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 372us (579us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787381470.722284:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787381470.722609:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166fb24000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5794:1874205065933568:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787381470.722667:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1787381470.722707:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea0fcd4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.722717:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea0fcd4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.722725:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea0fcd4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.722730:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c9400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381470.722746:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea0fcd4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.722754:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea0fcd4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.722770:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1650b8f200) 00010000:00010000:3.0:1787381470.722773:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787381470.722778:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea0fcd4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381470.722784:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea0fcd4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787381470.723218:0:5794:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787381470.723569:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1787381470.723581:0:5794:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 328854576064ns, next at 329854573870ns, rc = 0 00000001:00080000:3.0:1787381470.723589:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1787381470.723629:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1650b8f200) 00010000:00010000:3.0:1787381470.723632:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787381470.723640:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea0fcbf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95374a expref: 27 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381470.723769:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+26:10272:x1874205047026816:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 15968us (16141us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1787381470.723779:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 8 00000020:00080000:3.0:1787381470.723784:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787381470.728476:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381470.728771:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047027072 00000100:00100000:1.0:1787381470.728781:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047027072 00000100:00100000:1.0:1787381470.728879:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 45 00000100:00100000:1.0:1787381470.728889:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+26:10272:x1874205047027072:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1787381470.728922:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381470.728947:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0fcdb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953751 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381470.729062:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0fcdb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953751 expref: 27 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381470.729077:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0fcdb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953751 expref: 27 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381470.729098:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1659f89200) 00010000:00010000:1.0:1787381470.729101:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787381470.729105:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541388c00, rc 0) 00000100:00100000:1.0:1787381470.729165:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+27:10272:x1874205047027072:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 277us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381470.729182:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 45 00000100:00100000:2.0:1787381470.733117:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381470.733157:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047027328 00000100:00100000:2.0:1787381470.733165:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047027328 00000100:00100000:2.0:1787381470.733231:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:2.0:1787381470.733242:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166d3b9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+27:10272:x1874205047027328:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:2.0:1787381470.733717:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166d3b9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+28:10272:x1874205047027328:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 475us (608us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1787381470.733726:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:2.0:1787381470.875435:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381470.875651:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047027584 00000100:00100000:3.0:1787381470.875662:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047027584 00000100:00100000:3.0:1787381470.875725:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00100000:3.0:1787381470.875738:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fb27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+28:10282:x1874205047027584:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1787381470.875781:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381470.875804:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea0fce2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953758 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787381470.875948:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787381470.876589:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea0fce2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953758 expref: 30 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.876607:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1643af1b00) 00010000:00010000:2.0:1787381470.876610:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787381470.876615:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea0fce2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953758 expref: 30 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.876631:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb0600, rc 0) 00000100:00100000:2.0:1787381470.876703:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fb27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+29:10282:x1874205047027584:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 969us (1279us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1787381470.876711:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00100000:3.0:1787381470.885547:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381470.885674:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047027712 00000100:00100000:0.0:1787381470.885684:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047027712 00000100:00100000:0.0:1787381470.885741:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:0.0:1787381470.885750:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a803b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+29:10282:x1874205047027712:12345-192.168.203.22@tcp:34:lfs.0 00010000:00010000:0.0:1787381470.885839:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea0fcf0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.885861:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea0fcf0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.885874:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea0fcf0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.885889:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea0fcf7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.885906:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea0fcf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.885913:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea0fcf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.886059:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea0fcfe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.886068:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea0fcfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.886076:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea0fcfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787381470.886116:0:11324:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea0fcfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.886128:0:11324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea0fcf0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.886135:0:11324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea0fcf0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.886141:0:11324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea0fcf0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.886147:0:11324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c9600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787381470.886151:0:11324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea0fcf0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.886158:0:11324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea0fcf0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.886169:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a1643052a00) 00010000:00010000:0.0:1787381470.886182:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787381470.886186:0:11324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea0fcf0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.886425:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea0fcf0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.886439:0:11324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea0fcf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.886445:0:11324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea0fcf7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.886450:0:11324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea0fcf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.886455:0:11324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c9000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787381470.886458:0:11324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea0fcf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.886463:0:11324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea0fcf7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.886471:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a1643af1300) 00010000:00010000:0.0:1787381470.886474:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787381470.886477:0:11324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea0fcf7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.886482:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea0fcf7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.886495:0:11324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea0fcfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.886501:0:11324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea0fcfe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.886512:0:11324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea0fcfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.886517:0:11324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c8a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787381470.886520:0:11324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea0fcfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.886526:0:11324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea0fcfe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.886534:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1659f89200) 00010000:00010000:0.0:1787381470.886536:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787381470.886539:0:11324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea0fcfe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381470.886544:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea0fcfe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381470.886624:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a803b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+29:10282:x1874205047027712:12345-192.168.203.22@tcp:34:lfs.0 Request processed in 873us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381470.886631:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:1.0:1787381470.892960:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381470.893201:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047027968 00000100:00100000:2.0:1787381470.893211:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047027968 00000100:00100000:2.0:1787381470.893278:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:2.0:1787381470.893289:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f931180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+29:10282:x1874205047027968:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:2.0:1787381470.893840:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f931180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+30:10282:x1874205047027968:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 550us (888us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1787381470.893848:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:3.0:1787381470.961715:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381470.961919:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047028224 00000100:00100000:1.0:1787381470.961928:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047028224 00000100:00100000:1.0:1787381470.961991:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 48 00000100:00100000:1.0:1787381470.962001:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+30:10285:x1874205047028224:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1787381470.962072:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381470.962094:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fd05 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a95375f expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381470.962194:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fd0c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381470.962210:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fd0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381470.962241:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fd0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381470.962257:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381470.962273:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381470.962280:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381470.962722:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fd1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381470.962732:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fd1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381470.962739:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fd1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787381470.962750:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787381470.962844:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fd0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381470.962852:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fd0c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381470.962858:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fd0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381470.962864:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541389e00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381470.962875:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fd0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381470.962883:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fd0c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381470.962896:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a1643052a00) 00010000:00010000:1.0:1787381470.962900:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381470.962905:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fd0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381470.962911:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fd0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381470.962925:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381470.962932:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd13 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381470.962937:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381470.962943:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381470.962945:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381470.962951:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381470.962958:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a1659f89e00) 00010000:00010000:1.0:1787381470.962960:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381470.962969:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd13 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381470.962975:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381470.963200:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fd05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95375f expref: 33 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381470.963215:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fd1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95375f expref: 32 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381470.963222:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1659f89200) 00010000:00010000:1.0:1787381470.963224:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787381470.963227:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541389c00, rc 0) 00000100:00100000:1.0:1787381470.963300:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+32:10285:x1874205047028224:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 1299us (1592us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1787381470.963308:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 48 00000100:00100000:0.0:1787381470.966562:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381470.966669:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047028352 00000100:00100000:2.0:1787381470.966680:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047028352 00000100:00100000:2.0:1787381470.966772:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 49 00000100:00100000:2.0:1787381470.966781:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+32:10285:x1874205047028352:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:2.0:1787381470.966847:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fd28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.966863:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fd28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.966874:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fd28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.966910:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fd28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.966917:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fd28 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.966943:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fd28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.966949:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681732a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381470.966953:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fd28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.966960:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fd28 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.966972:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1659f89200) 00010000:00010000:2.0:1787381470.966975:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787381470.966979:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fd28 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381470.966985:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fd28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381470.967489:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+32:10285:x1874205047028352:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 707us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381470.967499:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 49 00000100:00100000:0.0:1787381470.972763:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381470.972860:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047028608 00000100:00100000:2.0:1787381470.972869:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047028608 00000100:00100000:2.0:1787381470.972942:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:2.0:1787381470.972953:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+32:10285:x1874205047028608:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:2.0:1787381470.973251:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+33:10285:x1874205047028608:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 300us (497us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1787381470.973259:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 11 00010000:00010000:2.0:1787381471.117690:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787381471.320698:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381471.320816:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047028864 00000100:00100000:2.0:1787381471.320826:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047028864 00000100:00100000:2.0:1787381471.320894:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 50 00000100:00100000:2.0:1787381471.320904:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+33:10316:x1874205047028864:12345-192.168.203.22@tcp:101:cat.0 00010000:00010000:2.0:1787381471.320927:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381471.320945:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fd2f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953766 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381471.321066:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0fd36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381471.321079:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0fd36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381471.321091:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0fd36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787381471.321101:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787381471.321246:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fd2f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953766 expref: 36 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381471.321265:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0fd36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953766 expref: 35 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381471.321274:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1659f89200) 00010000:00010000:2.0:1787381471.321277:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787381471.321281:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1681733200, rc 0) 00000100:00100000:2.0:1787381471.321348:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+35:10316:x1874205047028864:12345-192.168.203.22@tcp:101:cat.0 Request processed in 445us (659us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1787381471.321372:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 50 00000100:00100000:0.0:1787381471.329955:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381471.330048:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047028992 00000100:00100000:3.0:1787381471.330059:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047028992 00000100:00100000:3.0:1787381471.330136:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 3 00000100:00100000:3.0:1787381471.330147:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166d05c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2157c09-10df-40cb-8228-ad4822122c97+35:2352:x1874205047028992:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787381471.330164:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787381471.330202:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0fd36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953766 expref: 35 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381471.330223:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1659f89200) 00010000:00010000:3.0:1787381471.330228:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787381471.330293:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166d05c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2157c09-10df-40cb-8228-ad4822122c97+34:2352:x1874205047028992:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 147us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381471.330301:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 3 00000100:00100000:0.0:1787381471.348284:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381471.349305:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047029248 00000100:00100000:1.0:1787381471.349316:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047029248 00000100:00100000:1.0:1787381471.349401:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:1.0:1787381471.349412:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+34:10316:x1874205047029248:12345-192.168.203.22@tcp:35:cat.0 00000100:00100000:1.0:1787381471.349692:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+35:10316:x1874205047029248:12345-192.168.203.22@tcp:35:cat.0 Request processed in 281us (1416us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1787381471.349701:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:2.0:1787381471.463915:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381471.464044:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047029504 00000100:00100000:1.0:1787381471.464053:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047029504 00000100:00100000:1.0:1787381471.464112:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 51 00000100:00100000:1.0:1787381471.464122:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+35:10322:x1874205047029504:12345-192.168.203.22@tcp:101:dd.0 00010000:00010000:1.0:1787381471.464158:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381471.464161:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787381471.464193:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0fc9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95373c expref: 35 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381471.464211:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a1643052a00) 00010000:00010000:1.0:1787381471.464215:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787381471.464228:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fd44 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a95376d expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381471.464317:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd4b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381471.464344:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fd1a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95375f expref: 35 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381471.464358:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd4b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381471.464387:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fd1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95375f expref: 35 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381471.464407:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fd1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95375f expref: 35 pid: 5790 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381471.464420:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f931880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1874205065933696:192.168.203.22@tcp:104: 00000100:00100000:1.0:1787381471.464509:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fbac180 going to sleep for 11 seconds 00000100:00100000:0.0:1787381471.471108:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381471.471268:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047029632 00000100:00100000:3.0:1787381471.471277:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047029632 00010000:00010000:3.0:1787381471.471316:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fd1a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95375f expref: 36 pid: 5790 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381471.471371:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 38 00000100:00100000:3.0:1787381471.471405:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+36:2349:x1874205047029632:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787381471.471421:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787381471.471428:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fd1a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95375f expref: 36 pid: 5790 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381471.471442:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fd1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95375f expref: 36 pid: 5790 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381471.471465:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1659f89200) 00010000:00010000:3.0:1787381471.471470:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd4b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381471.471478:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd4b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381471.471485:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd4b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381471.471503:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787381471.471557:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+36:2349:x1874205047029632:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 163us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381471.471564:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 38 00010000:00010000:1.0:1787381471.472136:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fd1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95375f expref: 35 pid: 5790 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381471.472163:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f931880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1874205065933696:192.168.203.22@tcp:104: 00010000:00010000:1.0:1787381471.472193:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd4b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381471.472202:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd4b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381471.472209:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd4b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787381471.472227:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787381471.472559:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fd44 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95376d expref: 36 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381471.472575:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd4b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95376d expref: 35 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381471.472583:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1659f89200) 00010000:00010000:1.0:1787381471.472586:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787381471.472588:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541388a00, rc 0) 00000100:00100000:1.0:1787381471.472641:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+35:10322:x1874205047029504:12345-192.168.203.22@tcp:101:dd.0 Request processed in 8520us (8735us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1787381471.472650:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 51 00000100:00100000:0.0:1787381471.478536:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381471.478768:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047029888 00000100:00100000:2.0:1787381471.478777:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047029888 00000100:00100000:2.0:1787381471.478831:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 52 00000100:00100000:2.0:1787381471.478840:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+35:10322:x1874205047029888:12345-192.168.203.22@tcp:36:dd.0 00010000:00010000:2.0:1787381471.479162:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fd59 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381471.479191:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fd59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381471.479204:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fd59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787381471.479252:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1787381471.479275:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000054db00fc reply state 000000008ed9a3b7 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fd59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381471.479284:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787381471.479595:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+38:10322:x1874205047029888:12345-192.168.203.22@tcp:36:dd.0 Request processed in 752us (1065us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1787381471.479603:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 52 00000020:00080000:2.0:1787381471.479608:0:5792:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787381471.481842:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fd59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381471.481860:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fd59 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381471.481868:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fd59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381471.481892:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681732800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381471.481898:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fd59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381471.481906:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fd59 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381471.481924:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1659f89200) 00010000:00010000:3.0:1787381471.481927:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381471.481932:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fd59 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381471.481938:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fd59 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381471.893290:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381471.893408:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047030016 00000100:00100000:1.0:1787381471.893420:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047030016 00000100:00100000:1.0:1787381471.893486:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 53 00000100:00100000:1.0:1787381471.893497:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+37:10336:x1874205047030016:12345-192.168.203.22@tcp:101:stat.0 00010000:00010000:1.0:1787381471.893532:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381471.893554:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fd60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953774 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381471.893624:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fd67 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381471.893638:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fd67 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381471.893663:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fd67 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381471.893681:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fd6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381471.893688:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fd6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381471.893695:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fd6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381471.893801:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0fd75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381471.893813:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd4b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95376d expref: 38 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381471.893820:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0fd75 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381471.893870:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd4b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95376d expref: 38 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381471.893891:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd4b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95376d expref: 38 pid: 8469 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381471.893904:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f931880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1874205065933824:192.168.203.22@tcp:104: 00000100:00100000:1.0:1787381471.894042:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fbac300 going to sleep for 11 seconds 00000100:00100000:1.0:1787381471.900088:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f931880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1874205065933824:192.168.203.22@tcp:104: 00010000:00010000:1.0:1787381471.900117:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0fd75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381471.902128:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381471.905722:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047030272 00000100:00100000:1.0:1787381471.905738:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047030272 00000100:00100000:1.0:1787381471.905813:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:1.0:1787381471.905824:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+39:5563:x1874205047030272:12345-192.168.203.22@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787381471.906191:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+40:5563:x1874205047030272:12345-192.168.203.22@tcp:35:ldlm_bl.0 Request processed in 368us (4071us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1787381471.906200:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:0.0:1787381471.916680:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381471.925953:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047030400 00000100:00100000:1.0:1787381471.925969:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047030400 00010000:00010000:1.0:1787381471.926039:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd4b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95376d expref: 40 pid: 8469 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381471.926096:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00100000:1.0:1787381471.926106:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+40:2349:x1874205047030400:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787381471.926124:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381471.926148:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd4b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95376d expref: 40 pid: 8469 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381471.926486:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd4b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95376d expref: 40 pid: 8469 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381471.926513:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd4b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95376d expref: 40 pid: 8469 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381471.926983:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1659f89200) 00010000:00010000:1.0:1787381471.926990:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0fd75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381471.926999:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0fd75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381471.927059:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0fd75 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381471.927155:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381471.927240:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+39:2349:x1874205047030400:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 1133us (10568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381471.927250:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 39 00010000:00010000:2.0:1787381471.933600:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0fd75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381471.933689:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0fd75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787381471.933776:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787381471.933782:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787381471.933827:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0fd75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381471.933844:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0fd75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381471.933856:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fd67 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381471.933861:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fd67 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381471.933868:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fd67 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381471.933874:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541389c00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381471.933878:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fd67 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381471.933885:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fd67 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381471.933900:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a1643052a00) 00010000:00010000:2.0:1787381471.933903:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381471.933907:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fd67 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381471.933912:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fd67 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381471.934039:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fd6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381471.934046:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fd6e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381471.934053:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fd6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381471.934058:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541389e00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381471.934060:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fd6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381471.934066:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fd6e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381471.934075:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a1659f89e00) 00010000:00010000:2.0:1787381471.934078:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381471.934081:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fd6e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381471.934086:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fd6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381471.934139:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fd60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953774 expref: 39 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381471.934239:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0fd75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953774 expref: 38 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381471.934260:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1659f89200) 00010000:00010000:2.0:1787381471.934262:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787381471.934265:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541389a00, rc 0) 00000100:00100000:2.0:1787381471.934478:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+38:10336:x1874205047030016:12345-192.168.203.22@tcp:101:stat.0 Request processed in 40981us (41196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381471.934488:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 53 00000100:00100000:0.0:1787381472.022564:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381472.022653:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047030656 00000100:00100000:1.0:1787381472.022664:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047030656 00000100:00080000:0.0:1787381472.022814:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787381472.022855:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 54 00000100:00100000:1.0:1787381472.022867:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+38:10342:x1874205047030656:12345-192.168.203.22@tcp:36:truncate.0 00010000:00010000:1.0:1787381472.022935:0:8469:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381472.022962:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0fd75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953774 expref: 38 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.022996:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1659f89200) 00010000:00010000:1.0:1787381472.023002:0:8469:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787381472.023277:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd7c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.023290:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.023311:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787381472.023359:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1787381472.023380:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000361d2e1a reply state 00000000e4107dd3 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381472.023388:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787381472.025031:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+40:10342:x1874205047030656:12345-192.168.203.22@tcp:36:truncate.0 Request processed in 2154us (2462us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1787381472.025044:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 54 00000020:00080000:1.0:1787381472.025054:0:8469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787381472.036881:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381472.037388:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd7c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381472.037395:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381472.037401:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381472.037406:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381472.037414:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd7c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381472.037431:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1659f89200) 00010000:00010000:2.0:1787381472.037434:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381472.037438:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd7c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381472.037443:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd7c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.140194:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787381472.240750:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381472.240858:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047030784 00000100:00100000:1.0:1787381472.240869:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047030784 00000100:00100000:1.0:1787381472.240942:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:1.0:1787381472.240953:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+39:10356:x1874205047030784:12345-192.168.203.22@tcp:101:stat.0 00010000:00010000:1.0:1787381472.240978:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381472.240998:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0fd83 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a95377b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.241124:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd8a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.241139:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.241150:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.241174:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fd91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.241180:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fd91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.241187:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fd91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.241306:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fd98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.241315:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fd98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.241323:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fd98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787381472.241742:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1787381472.241747:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787381472.241770:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fd98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.241795:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fd98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.241804:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.241810:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd8a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.241817:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.241823:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381472.241827:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.241834:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd8a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.241845:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a1643052a00) 00010000:00010000:1.0:1787381472.241848:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381472.241852:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.241857:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fd8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.241869:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fd91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.243623:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fd91 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.243649:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fd91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.243655:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381472.243659:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fd91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.243668:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fd91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.243683:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a1659f89800) 00010000:00010000:1.0:1787381472.243686:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381472.243690:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fd91 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.243696:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fd91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.243762:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0fd83 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95377b expref: 41 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.243778:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fd98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95377b expref: 40 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.243786:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1659f89200) 00010000:00010000:1.0:1787381472.243788:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787381472.243791:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541389e00, rc 0) 00000100:00100000:1.0:1787381472.244038:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+40:10356:x1874205047030784:12345-192.168.203.22@tcp:101:stat.0 Request processed in 2922us (3133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381472.244059:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:0.0:1787381472.338599:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381472.338821:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047031040 00000100:00100000:1.0:1787381472.338833:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047031040 00000100:00100000:1.0:1787381472.339064:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 56 00000100:00100000:1.0:1787381472.339172:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+40:10366:x1874205047031040:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1787381472.339454:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381472.339480:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0fd9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953782 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787381472.339619:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787381472.339739:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0fd9f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953782 expref: 42 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.339754:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1643af1b00) 00010000:00010000:1.0:1787381472.339757:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787381472.339762:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0fd9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953782 expref: 42 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.339775:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541389a00, rc 0) 00000100:00100000:1.0:1787381472.339836:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+41:10366:x1874205047031040:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 678us (1615us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1787381472.339844:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 56 00000100:00100000:0.0:1787381472.355561:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381472.360938:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047031296 00000100:00100000:1.0:1787381472.360953:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047031296 00000100:00100000:1.0:1787381472.361043:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:1.0:1787381472.361055:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+41:10366:x1874205047031296:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:1.0:1787381472.365109:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+42:10366:x1874205047031296:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 4053us (9552us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1787381472.365120:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:0.0:1787381472.514065:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381472.514330:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047031552 00000100:00100000:2.0:1787381472.514340:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047031552 00000100:00100000:2.0:1787381472.514450:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 57 00000100:00100000:2.0:1787381472.514461:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+42:10372:x1874205047031552:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:2.0:1787381472.514485:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381472.514504:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fdad lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953789 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381472.514610:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0fdb4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381472.514626:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fd98 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95377b expref: 43 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381472.514635:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0fdb4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381472.514669:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fd98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95377b expref: 43 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381472.514682:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fd98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95377b expref: 43 pid: 5790 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381472.514696:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167ab42680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1874205065933952:192.168.203.22@tcp:104: 00000100:00100000:2.0:1787381472.514800:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1646dc3300 going to sleep for 11 seconds 00000100:00100000:0.0:1787381472.520705:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381472.520710:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167ab42680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1874205065933952:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787381472.520743:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0fdb4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381472.520826:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047031680 00000100:00100000:3.0:1787381472.520835:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047031680 00010000:00010000:3.0:1787381472.520886:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fd98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95377b expref: 44 pid: 5790 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381472.521054:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 40 00000100:00100000:3.0:1787381472.521066:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2157c09-10df-40cb-8228-ad4822122c97+44:2349:x1874205047031680:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787381472.521553:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787381472.521562:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fd98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95377b expref: 44 pid: 5790 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381472.521577:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fd98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95377b expref: 44 pid: 5790 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381472.521615:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0fd98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95377b expref: 44 pid: 5790 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381472.521633:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1659f89200) 00010000:00010000:3.0:1787381472.521638:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0fdb4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381472.521647:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0fdb4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381472.521654:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0fdb4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381472.521684:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787381472.521735:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2157c09-10df-40cb-8228-ad4822122c97+43:2349:x1874205047031680:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 671us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381472.521743:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 40 00010000:00010000:2.0:1787381472.521861:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0fdb4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381472.521870:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0fdb4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787381472.521890:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1787381472.522139:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fdad lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953789 expref: 44 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381472.522155:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0fdb4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953789 expref: 43 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381472.522172:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1659f89200) 00010000:00010000:2.0:1787381472.522175:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787381472.522177:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1681733000, rc 0) 00000100:00100000:2.0:1787381472.522209:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+43:10372:x1874205047031552:12345-192.168.203.22@tcp:101:bash.0 Request processed in 7750us (8156us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1787381472.523120:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 57 00000100:00100000:0.0:1787381472.528892:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381472.529040:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047031936 00000100:00100000:1.0:1787381472.529049:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047031936 00000100:00100000:1.0:1787381472.529115:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 58 00000100:00100000:1.0:1787381472.529126:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+43:10372:x1874205047031936:12345-192.168.203.22@tcp:36:bash.0 00010000:00010000:1.0:1787381472.529434:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0fdc2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.529453:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0fdc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.529465:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0fdc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787381472.529520:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1787381472.529545:0:5790:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f9b111be reply state 00000000ce69f697 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0fdc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381472.529554:0:5790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787381472.529831:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+46:10372:x1874205047031936:12345-192.168.203.22@tcp:36:bash.0 Request processed in 705us (945us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1787381472.529840:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 58 00000020:00080000:1.0:1787381472.529845:0:5790:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787381472.540387:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0fdc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381472.540403:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0fdc2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381472.540449:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0fdc2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381472.540455:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541389a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381472.540459:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0fdc2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381472.540483:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0fdc2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381472.540499:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1659f89200) 00010000:00010000:3.0:1787381472.540502:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381472.540506:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0fdc2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381472.540512:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0fdc2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381472.548110:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381472.548282:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047032064 00000100:00100000:1.0:1787381472.548293:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047032064 00000100:00100000:1.0:1787381472.548355:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 59 00000100:00100000:1.0:1787381472.548364:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+45:10372:x1874205047032064:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:1.0:1787381472.548404:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381472.548426:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fdc9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953790 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.548523:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fdd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.548539:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0fdb4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953789 expref: 46 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.548547:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fdd0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.548577:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0fdb4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953789 expref: 46 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.548588:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0fdb4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953789 expref: 46 pid: 5792 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381472.548770:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f931880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1874205065934080:192.168.203.22@tcp:104: 00000100:00100000:1.0:1787381472.548852:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fbac900 going to sleep for 11 seconds 00000100:00100000:0.0:1787381472.556122:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381472.556446:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f931880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1874205065934080:192.168.203.22@tcp:104: 00010000:00010000:1.0:1787381472.556476:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fdd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381472.556705:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047032192 00000100:00100000:2.0:1787381472.556713:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047032192 00010000:00010000:2.0:1787381472.556752:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0fdb4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953789 expref: 47 pid: 5792 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381472.556851:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 41 00000100:00100000:2.0:1787381472.556861:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f5c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+47:2350:x1874205047032192:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787381472.556875:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381472.556903:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0fdb4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953789 expref: 47 pid: 5792 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381472.556916:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0fdb4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953789 expref: 47 pid: 5792 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381472.556941:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0fdb4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953789 expref: 47 pid: 5792 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381472.556957:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1659f89200) 00010000:00010000:2.0:1787381472.556963:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fdd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381472.556973:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fdd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381472.556980:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fdd0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381472.557049:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787381472.557101:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f5c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+46:2350:x1874205047032192:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 242us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381472.557108:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 41 00010000:00010000:1.0:1787381472.557172:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fdd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.557180:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fdd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787381472.557236:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787381472.557240:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787381472.557274:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fdd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.557303:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fdc9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953790 expref: 46 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.557328:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fdd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953790 expref: 45 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.557336:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1659f89200) 00010000:00010000:1.0:1787381472.557338:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787381472.557341:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541388a00, rc 0) 00000100:00100000:1.0:1787381472.557367:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+45:10372:x1874205047032064:12345-192.168.203.22@tcp:101:bash.0 Request processed in 9005us (9266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381472.557374:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 59 00000100:00100000:0.0:1787381472.571525:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381472.573791:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047032448 00000100:00100000:2.0:1787381472.573804:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047032448 00000100:00100000:2.0:1787381472.573869:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:2.0:1787381472.573879:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166d3bac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+45:10372:x1874205047032448:12345-192.168.203.22@tcp:35:bash.0 00000100:00100000:2.0:1787381472.574228:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166d3bac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+46:10372:x1874205047032448:12345-192.168.203.22@tcp:35:bash.0 Request processed in 350us (2714us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1787381472.574246:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:2.0:1787381472.693793:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381472.694990:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047032704 00000100:00100000:1.0:1787381472.695014:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047032704 00000100:00100000:1.0:1787381472.695075:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 60 00000100:00100000:1.0:1787381472.695093:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167ab42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+46:10382:x1874205047032704:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1787381472.695116:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381472.695134:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fdd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953797 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787381472.696144:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787381472.696280:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fdd7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953797 expref: 48 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.696309:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1643af1b00) 00010000:00010000:1.0:1787381472.696312:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787381472.696317:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fdd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953797 expref: 48 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.696331:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541388600, rc 0) 00000100:00100000:1.0:1787381472.696398:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167ab42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+47:10382:x1874205047032704:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 1307us (2615us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1787381472.696407:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 60 00000100:00100000:0.0:1787381472.706861:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381472.706964:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047032832 00000100:00100000:1.0:1787381472.706974:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047032832 00000100:00100000:1.0:1787381472.707067:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 61 00000100:00100000:1.0:1787381472.707078:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f5c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+47:10382:x1874205047032832:12345-192.168.203.22@tcp:34:lfs.0 00010000:00010000:1.0:1787381472.707150:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fde5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.707179:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fde5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.707192:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fde5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.707207:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fdec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.707215:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fdec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.707239:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fdec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.707337:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea0fdf3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.707346:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea0fdf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.707352:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea0fdf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787381472.707392:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea0fdf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.707405:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fde5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.707411:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fde5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.707418:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fde5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.707424:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381472.707428:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fde5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.707435:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fde5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.707447:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a1643052a00) 00010000:00010000:1.0:1787381472.707457:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381472.707462:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fde5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.707469:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fde5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.707484:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fdec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.707490:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fdec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.707496:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fdec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.707502:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541389c00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381472.707504:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fdec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.707510:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fdec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.707518:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a1659f89800) 00010000:00010000:1.0:1787381472.707520:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381472.707523:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fdec lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.707529:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fdec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.707543:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea0fdf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.707556:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea0fdf3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.707562:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea0fdf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.707568:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541389800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381472.707570:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea0fdf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.707576:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea0fdf3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.707584:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1659f89200) 00010000:00010000:1.0:1787381472.707587:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381472.707590:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea0fdf3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.707596:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea0fdf3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381472.707678:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f5c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+47:10382:x1874205047032832:12345-192.168.203.22@tcp:34:lfs.0 Request processed in 600us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381472.707687:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 61 00000100:00100000:0.0:1787381472.710511:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381472.710585:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047033088 00000100:00100000:1.0:1787381472.710594:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047033088 00000100:00100000:1.0:1787381472.710640:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:1.0:1787381472.710649:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f5c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+47:10382:x1874205047033088:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:1.0:1787381472.710901:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f5c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+48:10382:x1874205047033088:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 252us (397us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1787381472.710921:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:2.0:1787381472.781252:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381472.781342:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047033344 00000100:00100000:1.0:1787381472.781352:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047033344 00000100:00100000:1.0:1787381472.781413:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 62 00000100:00100000:1.0:1787381472.781423:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+48:10385:x1874205047033344:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1787381472.781445:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381472.781464:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea0fdfa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a95379e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.781529:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fe01 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.781542:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fe01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.781553:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fe01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.781566:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fe08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.781573:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fe08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.781579:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fe08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.781702:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0fe0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.781726:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0fe0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.781733:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0fe0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787381472.781743:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787381472.781835:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fe01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.781843:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fe01 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.781850:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fe01 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.781855:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541389c00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381472.781859:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fe01 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.781867:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fe01 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.781877:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a1643052a00) 00010000:00010000:1.0:1787381472.781880:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381472.781884:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fe01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.781889:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fe01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.781901:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fe08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.781915:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fe08 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.781920:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fe08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.781925:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381472.781927:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fe08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.781933:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fe08 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.781940:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a1659f89800) 00010000:00010000:1.0:1787381472.781942:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381472.781945:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fe08 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.781949:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fe08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.781987:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea0fdfa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95379e expref: 51 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.781999:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0fe0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95379e expref: 50 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.782172:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1659f89200) 00010000:00010000:1.0:1787381472.782174:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787381472.782182:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541388800, rc 0) 00000100:00100000:1.0:1787381472.782288:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+50:10385:x1874205047033344:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 867us (1045us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1787381472.782297:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 62 00000100:00100000:0.0:1787381472.792058:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381472.792096:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381472.792197:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047033472 00000100:00100000:1.0:1787381472.792208:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047033472 00000100:00100000:1.0:1787381472.792272:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 63 00000100:00100000:1.0:1787381472.792283:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f5c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+50:10385:x1874205047033472:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:1.0:1787381472.792351:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea0fe1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.792368:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea0fe1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.792380:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea0fe1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.792409:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea0fe1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.792416:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea0fe1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.792423:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea0fe1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.792429:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541389800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381472.792434:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea0fe1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.792441:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea0fe1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.792468:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1659f89200) 00010000:00010000:1.0:1787381472.792471:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787381472.792476:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea0fe1d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.792482:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea0fe1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381472.792560:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f5c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+50:10385:x1874205047033472:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 279us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381472.792568:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 63 00000100:00100000:3.0:1787381472.793051:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047033600 00000100:00100000:3.0:1787381472.793057:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047033600 00000100:00100000:3.0:1787381472.793103:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:3.0:1787381472.793110:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f5c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2157c09-10df-40cb-8228-ad4822122c97+50:2352:x1874205047033600:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787381472.793121:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787381472.793136:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0fe0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95379e expref: 50 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381472.793148:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1659f89200) 00010000:00010000:3.0:1787381472.793152:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787381472.793200:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f5c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2157c09-10df-40cb-8228-ad4822122c97+49:2352:x1874205047033600:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 90us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381472.793206:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:0.0:1787381472.795683:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381472.795914:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047033856 00000100:00100000:1.0:1787381472.795922:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047033856 00000100:00100000:1.0:1787381472.795972:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:1.0:1787381472.795984:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f5c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+49:10385:x1874205047033856:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:1.0:1787381472.796247:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f5c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+50:10385:x1874205047033856:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 264us (572us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1787381472.796255:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:0.0:1787381472.983918:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381472.984062:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047034112 00000100:00100000:1.0:1787381472.984072:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047034112 00000100:00100000:1.0:1787381472.984131:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 64 00000100:00100000:1.0:1787381472.984141:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f5c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+50:10403:x1874205047034112:12345-192.168.203.22@tcp:101:cat.0 00010000:00010000:1.0:1787381472.984178:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381472.984201:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea0fe24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9537a5 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.984299:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fe2b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.984337:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fe2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.984563:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fe2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787381472.984576:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787381472.984704:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea0fe24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537a5 expref: 53 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.984722:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fe2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537a5 expref: 52 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381472.984731:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1659f89200) 00010000:00010000:1.0:1787381472.984733:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787381472.984737:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541388600, rc 0) 00000100:00100000:1.0:1787381472.984799:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f5c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+52:10403:x1874205047034112:12345-192.168.203.22@tcp:101:cat.0 Request processed in 660us (898us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1787381472.984807:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 64 00000100:00100000:0.0:1787381473.027612:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381473.027840:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047034240 00000100:00100000:2.0:1787381473.027852:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047034240 00000100:00100000:2.0:1787381473.027912:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 65 00000100:00100000:2.0:1787381473.027922:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f5c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+52:10404:x1874205047034240:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1787381473.027947:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381473.027969:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0fe39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9537ac expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.028063:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fe40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.028076:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fe40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.028088:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fe40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787381473.028146:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787381473.028150:0:8469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787381473.028184:0:8469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fe40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.028210:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0fe39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537ac expref: 54 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.028228:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fe40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537ac expref: 53 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.028250:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a1643052a00) 00010000:00010000:2.0:1787381473.028253:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787381473.028256:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1681732a00, rc 0) 00000100:00100000:2.0:1787381473.028318:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f5c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+53:10404:x1874205047034240:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 397us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381473.028324:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 65 00000100:00100000:0.0:1787381473.033143:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381473.033247:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047034624 00000100:00100000:1.0:1787381473.033258:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047034624 00000100:00100000:1.0:1787381473.033311:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:1.0:1787381473.033320:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f5c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+53:10404:x1874205047034624:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:1.0:1787381473.033642:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f5c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+54:10404:x1874205047034624:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 322us (506us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1787381473.033657:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:0.0:1787381473.038896:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381473.038987:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047034752 00000100:00100000:2.0:1787381473.038996:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047034752 00000100:00100000:2.0:1787381473.039085:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:2.0:1787381473.039096:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f5c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+54:10404:x1874205047034752:12345-192.168.203.22@tcp:103:lfs.0 00010000:00010000:2.0:1787381473.039112:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787381473.039139:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0fdd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953790 expref: 54 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.039170:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea0fe2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537a5 expref: 53 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.039182:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0fcdb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953751 expref: 52 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.039191:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1659f89200) 00010000:00010000:2.0:1787381473.039202:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787381473.039253:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f5c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+51:10404:x1874205047034752:12345-192.168.203.22@tcp:103:lfs.0 Request processed in 159us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381473.039260:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:0.0:1787381473.042292:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381473.042445:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047034880 00000100:00100000:3.0:1787381473.042455:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047034880 00000100:00100000:3.0:1787381473.042514:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 66 00000100:00100000:3.0:1787381473.042524:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f5c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+51:10404:x1874205047034880:12345-192.168.203.22@tcp:58:lfs.0 00010000:00010000:3.0:1787381473.043083:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea0fe47 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.043101:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea0fe47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.043112:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea0fe47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787381473.043587:0:11324:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787381473.047969:0:11324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1787381473.048077:0:11324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1787381473.048217:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f5c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+51:10404:x1874205047034880:12345-192.168.203.22@tcp:58:lfs.0 Request processed in 5687us (5927us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381473.048230:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 66 00000100:00100000:0.0:1787381473.090100:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381473.090226:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047035008 00000100:00100000:1.0:1787381473.090249:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047035008 00000100:00100000:1.0:1787381473.090335:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 67 00000100:00100000:1.0:1787381473.090346:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f5c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+51:10406:x1874205047035008:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1787381473.090365:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381473.090385:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea0fe4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9537b3 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.090447:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fe55 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.090460:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fe55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.090472:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fe55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.090487:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea0fe5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.090494:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea0fe5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.090500:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea0fe5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.090597:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea0fe63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.090606:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea0fe63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.090613:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea0fe63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787381473.090659:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787381473.090663:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787381473.090682:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea0fe63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.090693:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea0fe63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.090701:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fe55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.090707:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fe55 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.090714:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fe55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.090720:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541389c00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381473.090725:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fe55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.090732:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fe55 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.090742:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a1643052a00) 00010000:00010000:1.0:1787381473.090745:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381473.090750:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fe55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.090755:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea0fe55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.090779:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea0fe5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.090785:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea0fe5c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.090792:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea0fe5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.090797:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541389000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381473.090800:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea0fe5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.090806:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea0fe5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.090814:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a1659f89800) 00010000:00010000:1.0:1787381473.090817:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381473.090820:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea0fe5c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.090836:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea0fe5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.090867:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea0fe4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537b3 expref: 53 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.090880:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea0fe63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537b3 expref: 52 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.090899:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1643052500) 00010000:00010000:1.0:1787381473.090902:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787381473.090905:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541388000, rc 0) 00000100:00100000:1.0:1787381473.090968:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f5c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+52:10406:x1874205047035008:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 624us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381473.090975:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 67 00010000:00010000:2.0:1787381473.164384:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787381473.292354:0:11528:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787381473.292362:0:11528:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787381473.292413:0:11528:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787381473.292421:0:11528:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787381473.292545:0:11528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11528:1874205065934208:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787381473.292651:0:11528:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1650ba1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787381473.300378:0:11528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11528:1874205065934208:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787381473.301129:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381473.303346:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047035136 00000100:00100000:1.0:1787381473.303358:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047035136 00000100:00100000:1.0:1787381473.303418:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:1.0:1787381473.303429:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f5c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f2157c09-10df-40cb-8228-ad4822122c97+52:10417:x1874205047035136:12345-192.168.203.22@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787381473.303516:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f5c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f2157c09-10df-40cb-8228-ad4822122c97+52:10417:x1874205047035136:12345-192.168.203.22@tcp:900:lhsmtool_posix.0 Request processed in 89us (2682us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381473.303525:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:0.0:1787381473.312753:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381473.312855:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047035264 00000100:00100000:1.0:1787381473.312865:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047035264 00000100:00100000:1.0:1787381473.312929:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 68 00000100:00100000:1.0:1787381473.312939:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f5c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+52:10417:x1874205047035264:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787381473.312970:0:5792:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787381473.313100:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f5c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+52:10417:x1874205047035264:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 162us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381473.313108:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 68 00000100:00100000:1.0:1787381473.327472:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381473.332424:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047035392 00000100:00100000:3.0:1787381473.332439:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047035392 00000100:00100000:3.0:1787381473.332798:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 69 00000100:00100000:3.0:1787381473.332809:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f931880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+52:10417:x1874205047035392:12345-192.168.203.22@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787381473.332893:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea0fe6a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.332923:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea0fe6a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.332935:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea0fe6a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.332951:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea0fe71 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.332957:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea0fe71 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.332963:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea0fe71 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.332986:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea0fe78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.332994:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea0fe78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.332999:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea0fe78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787381473.333090:0:11324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787381473.333094:0:11324:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787381473.333104:0:11324:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea0fe78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.333116:0:11324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea0fe6a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.333134:0:11324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea0fe6a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.333139:0:11324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea0fe6a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.333144:0:11324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb0200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381473.333148:0:11324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea0fe6a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.333169:0:11324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea0fe6a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.333181:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a1643052000) 00010000:00010000:3.0:1787381473.333184:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381473.333189:0:11324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea0fe6a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.333194:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea0fe6a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.333204:0:11324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea0fe71 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.333209:0:11324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea0fe71 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.333214:0:11324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea0fe71 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.333218:0:11324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb1400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381473.333227:0:11324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea0fe71 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.333233:0:11324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea0fe71 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.333241:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9a1643052300) 00010000:00010000:3.0:1787381473.333243:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381473.333246:0:11324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea0fe71 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.333252:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea0fe71 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.333265:0:11324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea0fe78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.333270:0:11324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea0fe78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.333276:0:11324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea0fe78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.333280:0:11324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb0a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381473.333283:0:11324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea0fe78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.333288:0:11324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea0fe78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.333295:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1643052500) 00010000:00010000:3.0:1787381473.333298:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381473.333305:0:11324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea0fe78 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.333311:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea0fe78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381473.333464:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f931880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+52:10417:x1874205047035392:12345-192.168.203.22@tcp:34:lhsmtool_posix.0 Request processed in 656us (6000us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381473.333472:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 69 00000100:00100000:0.0:1787381473.336858:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381473.336976:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047035648 00000100:00100000:3.0:1787381473.336985:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047035648 00000100:00100000:3.0:1787381473.337070:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 70 00000100:00100000:3.0:1787381473.337079:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f5c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+52:10417:x1874205047035648:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787381473.337101:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381473.337120:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0000/0xbdc38ada7ea0fe7f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9537ba expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.337227:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea0fe86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.337241:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea0fe86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.337253:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea0fe86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787381473.337264:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787381473.337376:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea0fe86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.337384:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea0fe86 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.337402:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea0fe86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.337409:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb1c00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381473.337413:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea0fe86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.337421:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea0fe86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.337432:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1643052500) 00010000:00010000:3.0:1787381473.337435:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787381473.337439:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea0fe86 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.337445:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea0fe86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.337486:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0000/0xbdc38ada7ea0fe7f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537ba expref: 54 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.337496:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a1643052000) 00010000:00010000:3.0:1787381473.337498:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787381473.337502:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0000/0xbdc38ada7ea0fe7f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537ba expref: 54 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.337512:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb0000, rc 0) 00000100:00100000:3.0:1787381473.337569:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f5c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+53:10417:x1874205047035648:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 491us (720us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1787381473.337586:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 70 00000100:00100000:0.0:1787381473.343542:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381473.343626:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047035776 00000100:00100000:3.0:1787381473.343637:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047035776 00000100:00100000:3.0:1787381473.343696:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 71 00000100:00100000:3.0:1787381473.343707:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f5c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+53:10417:x1874205047035776:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787381473.343740:0:5791:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787381473.343865:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f5c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+53:10417:x1874205047035776:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 160us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381473.343873:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 71 00000100:00100000:3.0:1787381473.353176:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381473.353431:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047036032 00000100:00100000:0.0:1787381473.353456:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047036032 00000100:00100000:0.0:1787381473.353517:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 72 00000100:00100000:0.0:1787381473.353527:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+53:10417:x1874205047036032:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787381473.353547:0:11324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381473.353550:0:11324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787381473.353578:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fe40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537ac expref: 53 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381473.353598:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a1643052a00) 00010000:00010000:0.0:1787381473.353603:0:11324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787381473.353616:0:11324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9200/0xbdc38ada7ea0fe94 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9537c1 expref: -99 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787381473.354643:0:11324:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1787381473.354915:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea0fe9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381473.354929:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea0fe9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381473.355125:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea0fe9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381473.355201:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9200/0xbdc38ada7ea0fe94 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537c1 expref: 55 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381473.355218:0:11324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea0fe9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537c1 expref: 54 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381473.355241:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a1643af1300) 00010000:00010000:0.0:1787381473.355244:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787381473.355247:0:11324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16460c8e00, rc 0) 00000100:00100000:0.0:1787381473.355414:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+54:10417:x1874205047036032:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 1887us (2479us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1787381473.355423:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 72 00000100:00100000:3.0:1787381473.363193:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381473.363391:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047036288 00000100:00100000:1.0:1787381473.363402:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047036288 00000100:00100000:1.0:1787381473.363504:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 73 00000100:00100000:1.0:1787381473.363515:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+54:10417:x1874205047036288:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787381473.363574:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381473.363604:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea0fe9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537c1 expref: 54 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.363621:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a1643af1300) 00010000:00010000:1.0:1787381473.363630:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787381473.363651:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea0fea9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.363663:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea0fea9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.363672:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea0fea9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.363705:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea0feb0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xb335b62f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.363713:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea0feb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb335b62f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.363720:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea0feb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb335b62f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.363797:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea0fea9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.363803:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea0fea9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.363820:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea0fea9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.363826:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541389600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381473.363830:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea0fea9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.363838:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea0fea9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.363847:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a1643052a00) 00010000:00010000:1.0:1787381473.363849:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381473.363852:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea0fea9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.363859:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea0fea9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.363868:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea0feb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb335b62f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.363874:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea0feb0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb335b62f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.363881:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea0feb0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb335b62f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.363885:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541389000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381473.363888:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea0feb0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb335b62f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.363903:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea0feb0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb335b62f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.363911:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xb335b62f (ffff9a1659f89800) 00010000:00010000:1.0:1787381473.363913:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381473.363915:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea0feb0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb335b62f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.363921:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea0feb0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb335b62f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381473.364047:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+53:10417:x1874205047036288:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 533us (861us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787381473.364055:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 73 00000100:00100000:2.0:1787381473.368798:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381473.368937:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047036416 00000100:00100000:0.0:1787381473.368947:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047036416 00000100:00100000:0.0:1787381473.369194:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 74 00000100:00100000:0.0:1787381473.369208:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+53:10417:x1874205047036416:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787381473.369228:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381473.369250:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9200/0xbdc38ada7ea0feb7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9537c8 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381473.369285:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea0febe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381473.369297:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea0febe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381473.369308:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea0febe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381473.369572:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9200/0xbdc38ada7ea0feb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537c8 expref: 55 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381473.369586:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea0febe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537c8 expref: 54 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381473.369606:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a1643af1600) 00010000:00010000:0.0:1787381473.369608:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787381473.369611:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16460c9a00, rc 0) 00000100:00100000:0.0:1787381473.369750:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+54:10417:x1874205047036416:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 545us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381473.369758:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 74 00000100:00100000:0.0:1787381473.375927:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381473.376194:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047036672 00000100:00100000:3.0:1787381473.376204:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047036672 00000100:00100000:3.0:1787381473.376266:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 75 00000100:00100000:3.0:1787381473.376276:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f5c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+54:10417:x1874205047036672:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787381473.376369:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea0fec5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.376386:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea0fec5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.376398:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea0fec5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787381473.376816:0:11324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1787381473.377198:0:11324:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 331508192427ns, next at 332507928410ns, rc = 0 00000004:00010000:2.0:1787381473.377429:0:11324:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000728026b6 reply state 000000000236ceb3 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea0fec5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381473.377439:0:11324:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787381473.377721:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f5c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+56:10417:x1874205047036672:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 1374us (1731us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1787381473.377730:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 75 00010000:00010000:1.0:1787381473.379042:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea0fec5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.379059:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea0fec5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.379066:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea0fec5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.379072:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb0600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381473.379076:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea0fec5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.379084:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea0fec5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.379119:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a1643af1600) 00010000:00010000:1.0:1787381473.379122:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787381473.379126:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea0fec5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.379133:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea0fec5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381473.382798:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381473.382865:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047036800 00000100:00100000:1.0:1787381473.382876:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047036800 00000100:00100000:1.0:1787381473.382929:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 76 00000100:00100000:1.0:1787381473.382939:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f5c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+55:10417:x1874205047036800:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787381473.382963:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381473.382985:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea0fecc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9537cf expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.383076:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea0fecc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537cf expref: 56 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.383092:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea0fecc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537cf expref: 56 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.383112:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a1643af1600) 00010000:00010000:1.0:1787381473.383115:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787381473.383119:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541389000, rc 0) 00000100:00100000:1.0:1787381473.383179:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f5c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+56:10417:x1874205047036800:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 241us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381473.383203:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 76 00000100:00100000:2.0:1787381473.386664:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381473.386720:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047036928 00000100:00100000:0.0:1787381473.386730:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047036928 00000100:00100000:0.0:1787381473.386780:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 24 00000100:00100000:0.0:1787381473.386788:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1874205047036928:12345-192.168.203.22@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1787381473.386887:0:6590:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from f2157c09-10df-40cb-8228-ad4822122c97@192.168.203.22@tcp t0 exp 0000000000000000 cur 331 last 0 00000020:00000080:0.0:1787381473.386920:0:6590:0:(genops.c:1406:class_connect()) connect: client f2157c09-10df-40cb-8228-ad4822122c97, cookie 0xbdc38ada7ea0fed3 00002000:00100000:0.0:1787381473.386931:0:6590:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f2157c09-10df-40cb-8228-ad4822122c97/ffff9a1658057000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113673 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787381473.386957:0:6590:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787381473.387505:0:6590:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787381473.387543:0:6590:0:(import.c:65:import_set_state_nolock()) ffff9a167533b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787381473.387617:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2157c09-10df-40cb-8228-ad4822122c97+6:2348:x1874205047036928:12345-192.168.203.22@tcp:8:lhsmtool_posix.0 Request processed in 828us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381473.387626:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 24 00000100:00100000:2.0:1787381473.391433:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381473.391569:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047037056 00000100:00100000:0.0:1787381473.391579:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047037056 00000100:00100000:0.0:1787381473.391698:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:0.0:1787381473.391709:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2157c09-10df-40cb-8228-ad4822122c97+6:0:x1874205047037056:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1787381473.395151:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1787381473.443378:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:2.0:1787381473.443399:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f2157c09-10df-40cb-8228-ad4822122c97 00000100:00100000:1.0:1787381473.444242:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2157c09-10df-40cb-8228-ad4822122c97+5:0:x1874205047037056:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 Request processed in 52527us (52810us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787381473.444256:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:0.0:1787381473.458650:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381473.458762:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047037312 00000100:00100000:1.0:1787381473.458772:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047037312 00000100:00100000:1.0:1787381473.458827:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:1.0:1787381473.458837:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1681722680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+56:10417:x1874205047037312:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787381473.459131:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1681722680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+57:10417:x1874205047037312:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 293us (489us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1787381473.459140:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:2.0:1787381473.465978:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381473.466162:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047037568 00000100:00100000:1.0:1787381473.466172:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047037568 00000100:00100000:1.0:1787381473.466232:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 77 00000100:00100000:1.0:1787381473.466242:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16461ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+57:10417:x1874205047037568:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787381473.466367:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16461ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+57:10417:x1874205047037568:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 127us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381473.466375:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 77 00000100:00100000:3.0:1787381473.478302:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381473.478672:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047037696 00000100:00100000:2.0:1787381473.478682:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047037696 00000100:00100000:2.0:1787381473.478779:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 78 00000100:00100000:2.0:1787381473.478789:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+57:10417:x1874205047037696:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787381473.478808:0:11324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381473.478827:0:11324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0feda lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9537d6 expref: -99 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.478906:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0fee1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.478927:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0fee1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.478939:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0fee1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787381473.478976:0:11324:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787381473.478994:0:11324:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0fee1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.479057:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0feda lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537d6 expref: 59 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.479074:0:11324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0fee1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537d6 expref: 58 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.479082:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a1643af1600) 00010000:00010000:2.0:1787381473.479085:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787381473.479088:0:11324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1681733000, rc 0) 00000100:00100000:2.0:1787381473.479149:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+58:10417:x1874205047037696:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 361us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381473.479165:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 78 00000100:00100000:0.0:1787381473.484209:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381473.484293:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047037824 00000100:00100000:2.0:1787381473.484303:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047037824 00000100:00100000:2.0:1787381473.486212:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 26 00000100:00100000:2.0:1787381473.486226:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1681721500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+5:2349:x1874205047037824:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787381473.486245:0:6588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381473.486285:0:6588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044417660/0xbdc38ada7ea0fee8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9537dd expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787381473.486325:0:6588:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8946e0, blocks: 0x1 00010000:00010000:2.0:1787381473.486348:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=331s v=(0 0) 00010000:00010000:2.0:1787381473.486353:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787381473.486363:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044417660/0xbdc38ada7ea0fee8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537dd expref: 6 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.486382:0:6588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000044417660/0xbdc38ada7ea0fee8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537dd expref: 6 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.486397:0:6588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1681733400, rc 0) 00000100:00100000:2.0:1787381473.486477:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1681721500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+6:2349:x1874205047037824:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 253us (2275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381473.486486:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 26 00000100:00100000:0.0:1787381473.497358:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381473.500681:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047038080 00000100:00100000:1.0:1787381473.500696:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047038080 00000100:00100000:1.0:1787381473.500770:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 79 00000100:00100000:1.0:1787381473.500781:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1681720000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+58:10417:x1874205047038080:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787381473.500896:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1681720000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+58:10417:x1874205047038080:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 116us (3545us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381473.500916:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 79 00000100:00100000:0.0:1787381473.533651:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381473.534626:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047038208 00000100:00100000:3.0:1787381473.534638:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047038208 00000100:00100000:3.0:1787381473.534698:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 27 00000100:00100000:3.0:1787381473.534707:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1681722300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2157c09-10df-40cb-8228-ad4822122c97+6:10417:x1874205047038208:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787381473.534726:0:7779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381473.534747:0:7779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b793ab2a/0xbdc38ada7ea0feef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9537e4 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.534780:0:7779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000044417660/0xbdc38ada7ea0fee8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537dd expref: 7 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.534789:0:7779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787381473.534793:0:7779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787381473.534798:0:7779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b793ab2a/0xbdc38ada7ea0feef lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537e4 expref: 7 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.534831:0:7779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000044417660/0xbdc38ada7ea0fee8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537dd expref: 7 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.534845:0:7779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000044417660/0xbdc38ada7ea0fee8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537dd expref: 7 pid: 6588 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381473.534859:0:7779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7779:1874205065934336:192.168.203.22@tcp:104: 00000100:00100000:3.0:1787381473.534953:0:7779:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1650ba1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787381473.539511:0:7779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7779:1874205065934336:192.168.203.22@tcp:104: 00010000:00010000:3.0:1787381473.539551:0:7779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b793ab2a/0xbdc38ada7ea0feef lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537e4 expref: 7 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.539583:0:7779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb0000, rc 0) 00000100:00100000:3.0:1787381473.539642:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1681722300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2157c09-10df-40cb-8228-ad4822122c97+7:10417:x1874205047038208:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 4936us (5999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381473.539652:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 27 00000100:00100000:3.0:1787381473.542703:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381473.542777:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047038336 00000100:00100000:2.0:1787381473.542787:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047038336 00010000:00010000:2.0:1787381473.542828:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000044417660/0xbdc38ada7ea0fee8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537dd expref: 7 pid: 6588 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381473.542875:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 42 00000100:00100000:2.0:1787381473.542886:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1665877450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+7:2349:x1874205047038336:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787381473.542903:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381473.542928:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000044417660/0xbdc38ada7ea0fee8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537dd expref: 7 pid: 6588 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.542965:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000044417660/0xbdc38ada7ea0fee8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537dd expref: 7 pid: 6588 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.542991:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044417660/0xbdc38ada7ea0fee8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537dd expref: 7 pid: 6588 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.543033:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787381473.543038:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787381473.543046:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b793ab2a/0xbdc38ada7ea0feef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537e4 expref: 6 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.543057:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b793ab2a/0xbdc38ada7ea0feef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537e4 expref: 6 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.543097:0:5777:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b793ab2a/0xbdc38ada7ea0feef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537e4 expref: 6 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381473.543112:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a804380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5777:1874205065934464:192.168.203.22@tcp:105: 00000100:00100000:2.0:1787381473.543219:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1642b90900 going to sleep for 11 seconds 00000100:00100000:3.0:1787381473.562941:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381473.563026:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a804380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5777:1874205065934464:192.168.203.22@tcp:105: 00010000:00010000:3.0:1787381473.563051:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787381473.563112:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1665877450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+6:2349:x1874205047038336:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 20227us (20415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381473.563123:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 42 00000100:00100000:3.0:1787381473.563324:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047038464 00000100:00100000:3.0:1787381473.563331:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047038464 00002000:00100000:3.0:1787381473.563371:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9a167f59ca80 x1874205047038464/t0(0) o4->f2157c09-10df-40cb-8228-ad4822122c97@192.168.203.22@tcp:524/0 lens 504/0 e 0 to 0 dl 1787381484 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787381473.563381:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a167f59ca80 with x1874205047038464 ext(0->8) 00002000:00010000:3.0:1787381473.563385:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a167f59ca80 00000100:00100000:3.0:1787381473.563406:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:3.0:1787381473.563414:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f2157c09-10df-40cb-8228-ad4822122c97+6:2350:x1874205047038464:12345-192.168.203.22@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787381473.564034:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f2157c09-10df-40cb-8228-ad4822122c97+8:2350:x1874205047038464:12345-192.168.203.22@tcp:4:lhsmtool_posix.0 Request processed in 618us (1099us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787381473.564043:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 0 00002000:00100000:3.0:1787381473.564049:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9a167f59ca80 x1874205047038464/t4294967302(0) o4->f2157c09-10df-40cb-8228-ad4822122c97@192.168.203.22@tcp:524/0 lens 504/448 e 0 to 0 dl 1787381484 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787381473.564063:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a167f59ca80 with x1874205047038464 ext(0->8) 00002000:00010000:3.0:1787381473.564067:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a167f59ca80 00000100:00100000:0.0:1787381473.580466:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381473.581375:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047038592 00000100:00100000:3.0:1787381473.581386:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047038592 00000100:00100000:3.0:1787381473.581451:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 80 00000100:00100000:3.0:1787381473.581462:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1681721f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+58:10417:x1874205047038592:12345-192.168.203.22@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787381473.614240:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787381473.614268:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065934592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787381473.614341:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381473.614660:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065934592 00000100:00100000:1.0:1787381473.614669:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065934592 00000100:00100000:1.0:1787381473.614741:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787381473.614752:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065934592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787381473.614775:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787381473.614824:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a804000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065934592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381473.614831:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1787381473.618930:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787381473.619061:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065934592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787381473.623427:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd19486c-5291-4823-bb9c-f3a73416a496:3310:1874205065934720:0@lo:400:kworker.0 00000100:00100000:1.0:1787381473.623629:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381473.623671:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1660095500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065935232:0@lo:400:kworker.0 00000100:00100000:1.0:1787381473.623698:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381473.623725:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787381473.623730:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874205065934848:0@lo:400:kworker.0 00000100:00100000:1.0:1787381473.623754:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381473.623781:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1874205065934976:0@lo:400:kworker.0 00000100:00100000:1.0:1787381473.623803:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381473.624390:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787381473.624400:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1874205065935104:0@lo:400:kworker.0 00000100:00100000:1.0:1787381473.624431:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381473.624647:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065934720 00000100:00100000:1.0:1787381473.624656:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065934720 00000100:00100000:1.0:1787381473.624711:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1787381473.624721:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+19:3310:x1874205065934720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381473.624839:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+19:3310:x1874205065934720:12345-0@lo:400:kworker.0 Request processed in 119us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381473.624847:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1787381473.624884:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065935232 00000100:00100000:1.0:1787381473.624888:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065935232 00000100:00100000:1.0:1787381473.624921:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787381473.624927:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1660094000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1874205065935232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381473.624959:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1660094000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1874205065935232:12345-0@lo:400:kworker.0 Request processed in 33us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381473.624966:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787381473.624985:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065934848 00000100:00100000:1.0:1787381473.624989:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065934848 00000100:00100000:1.0:1787381473.625033:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065934976 00000100:00100000:1.0:1787381473.625037:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065934976 00000100:00100000:1.0:1787381473.625051:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065935104 00000100:00100000:1.0:1787381473.625053:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065935104 00000100:00100000:1.0:1787381473.625067:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787381473.625073:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1660096300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874205065934848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381473.625123:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1660096300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874205065934848:12345-0@lo:400:kworker.0 Request processed in 49us (1367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381473.625141:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787381473.625163:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787381473.625169:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1660095f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874205065934976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381473.625200:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1660095f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874205065934976:12345-0@lo:400:kworker.0 Request processed in 32us (1396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381473.625206:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787381473.625216:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787381473.625229:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1660094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874205065935104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381473.625258:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1660094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874205065935104:12345-0@lo:400:kworker.0 Request processed in 30us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381473.625263:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:1.0:1787381473.625287:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787381473.625292:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787381473.625345:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f931180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1874205065935104:0@lo:400:kworker.0 00000100:00100000:1.0:1787381473.625372:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f930a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1874205065934976:0@lo:400:kworker.0 00000100:00100000:3.0:1787381473.635909:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f931c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd19486c-5291-4823-bb9c-f3a73416a496:3310:1874205065934720:0@lo:400:kworker.0 00000100:00100000:3.0:1787381473.636052:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1660095500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065935232:0@lo:400:kworker.0 00000100:00100000:3.0:1787381473.636080:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874205065934848:0@lo:400:kworker.0 00000100:00100000:0.0:1787381473.647821:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1681721f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+58:10417:x1874205047038592:12345-192.168.203.22@tcp:44:lhsmtool_posix.0 Request processed in 66349us (67359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381473.647837:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 80 00000001:00080000:0.0:1787381473.647877:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000001:00080000:0.0:1787381473.647896:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:0.0:1787381473.647959:0:5813:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:0.0:1787381473.647989:0:5813:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:2.0:1787381473.648178:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065935360:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787381473.648251:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1787381473.648308:0:5813:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a1675018f00 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1787381473.648314:0:5813:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9a1650b56d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a1675018540 00000020:00080000:0.0:1787381473.648317:0:5813:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9a16582fcc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a167f4c1400 00000100:00100000:2.0:1787381473.648322:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065935360 00000100:00100000:2.0:1787381473.648330:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065935360 00000100:00100000:2.0:1787381473.648376:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787381473.648386:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065935360:12345-0@lo:2:osp-syn-0-0.0 00000020:00080000:0.0:1787381473.648417:0:5825:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1787381473.648563:0:5825:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1787381473.648578:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1681720700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065935488:0@lo:6:osp-syn-1-0.0 00002000:00010000:2.0:1787381473.648582:0:6587:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787381473.648587:0:6587:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787381472 00002000:00010000:2.0:1787381473.648589:0:6587:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787381473.648592:0:6587:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787381472 -> 1787381472 00002000:00010000:2.0:1787381473.648594:0:6587:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787381473.648614:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381473.648645:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1874205065935360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 258us (392us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787381473.648653:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787381473.648656:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065935488 00000100:00100000:0.0:1787381473.648662:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065935488 00000100:00100000:0.0:1787381473.648695:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000004:00080000:2.0:1787381473.648704:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a167a804380/2, rc 0, transno 4294967303 00000100:00100000:0.0:1787381473.648704:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1681723480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1874205065935488:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787381473.648715:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a804380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065935360:0@lo:2:osp-syn-0-0.0 00002000:00080000:0.0:1787381473.648726:0:6588:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1787381473.648758:0:6588:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a8946dd, atime: 0x6a8946dd, ctime: 0x6a8946dd, blocks: 0x1 00010000:00010000:0.0:1787381473.648767:0:6588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006797d52b/0xbdc38ada7ea0fef6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381473.648796:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=331s v=(0 0) 00010000:00010000:0.0:1787381473.648801:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381473.648814:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006797d52b/0xbdc38ada7ea0fef6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381473.648832:0:6588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006797d52b/0xbdc38ada7ea0fef6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381473.648841:0:6588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006797d52b/0xbdc38ada7ea0fef6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381473.648849:0:6588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006797d52b/0xbdc38ada7ea0fef6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381473.648874:0:6588:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787381473.649024:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787381473.649031:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006797d52b/0xbdc38ada7ea0fef6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.649041:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c8e00 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:2.0:1787381473.649046:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006797d52b/0xbdc38ada7ea0fef6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.649055:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006797d52b/0xbdc38ada7ea0fef6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.649086:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006797d52b/0xbdc38ada7ea0fef6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.649094:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006797d52b/0xbdc38ada7ea0fef6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.649113:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381473.649115:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381473.649117:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787381473.651376:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1681723480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1874205065935488:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2667us (2755us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787381473.651391:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:0.0:1787381473.651453:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a1681720700/2, rc 0, transno 4294967301 00000100:00100000:0.0:1787381473.651461:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1681720700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065935488:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787381473.654979:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381473.656052:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047038720 00000100:00100000:3.0:1787381473.656065:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047038720 00000100:00100000:3.0:1787381473.656121:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 30 00000100:00100000:3.0:1787381473.658346:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2157c09-10df-40cb-8228-ad4822122c97+8:2350:x1874205047038720:12345-192.168.203.22@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787381473.711258:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:2.0:1787381473.711282:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:3.0:1787381473.711449:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2157c09-10df-40cb-8228-ad4822122c97+6:2350:x1874205047038720:12345-192.168.203.22@tcp:16:lhsmtool_posix.0 Request processed in 55314us (56472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381473.711461:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 30 00000100:00100000:3.0:1787381473.714530:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381473.714604:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047038976 00000100:00100000:1.0:1787381473.714614:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047038976 00000100:00100000:1.0:1787381473.714682:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 81 00000100:00100000:1.0:1787381473.714692:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+13:10417:x1874205047038976:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787381473.714746:0:11324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381473.714773:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0fee1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537d6 expref: 13 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.714792:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a1643af1600) 00010000:00010000:1.0:1787381473.714797:0:11324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787381473.714838:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea0fefd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.714852:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea0fefd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.714862:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea0fefd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787381473.715134:0:11324:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a5b06960 reply state 00000000624ab3a3 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea0fefd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381473.715162:0:11324:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787381473.715254:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+14:10417:x1874205047038976:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 562us (731us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1787381473.715262:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 81 00010000:00010000:3.0:1787381473.718165:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea0fefd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.718182:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea0fefd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.718201:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea0fefd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.718207:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541389800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381473.718211:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea0fefd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.718220:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea0fefd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.718237:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a1643af1600) 00010000:00010000:3.0:1787381473.718240:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381473.718244:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea0fefd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.718250:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea0fefd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381473.719835:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381473.720054:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047039104 00000100:00100000:0.0:1787381473.720063:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047039104 00000100:00100000:0.0:1787381473.720112:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 31 00000100:00100000:0.0:1787381473.720121:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+6:2349:x1874205047039104:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787381473.720560:0:6588:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787381473.720565:0:6588:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787381472 -> 1787381471 00002000:00010000:0.0:1787381473.720569:0:6588:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787381469 00002000:00010000:0.0:1787381473.720571:0:6588:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787381472 -> 1787381471 00002000:00010000:0.0:1787381473.720580:0:6588:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787381473.720642:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+7:2349:x1874205047039104:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 Request processed in 521us (822us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787381473.720651:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 31 00000100:00100000:0.0:1787381473.726880:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381473.726957:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047039360 00000100:00100000:1.0:1787381473.726968:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047039360 00000100:00100000:1.0:1787381473.727055:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 82 00000100:00100000:1.0:1787381473.727065:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1681723800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+13:10417:x1874205047039360:12345-192.168.203.22@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787381473.727136:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0ff04 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.727161:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea0febe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537c8 expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.727170:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0ff04 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.727207:0:5790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea0febe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537c8 expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.727221:0:5790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea0febe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537c8 expref: 13 pid: 5790 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381473.727235:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1660097480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5790:1874205065935616:192.168.203.22@tcp:104: 00000100:00100000:1.0:1787381473.727340:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fbaccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787381473.751803:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381473.751935:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047039488 00000100:00100000:3.0:1787381473.751947:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047039488 00010000:00010000:3.0:1787381473.752171:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea0febe lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537c8 expref: 14 pid: 5790 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381473.752208:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 43 00000100:00100000:3.0:1787381473.752217:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1660097800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2157c09-10df-40cb-8228-ad4822122c97+14:2350:x1874205047039488:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787381473.752231:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787381473.752238:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea0febe lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537c8 expref: 14 pid: 5790 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.752269:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea0febe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537c8 expref: 14 pid: 5790 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.752293:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a1643af1600) 00010000:00010000:3.0:1787381473.752298:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0ff04 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.752307:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0ff04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381473.752570:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea0febe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537c8 expref: 14 pid: 5790 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381473.752588:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1660097480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5790:1874205065935616:192.168.203.22@tcp:104: 00010000:00010000:3.0:1787381473.752641:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0ff04 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381473.754487:0:5790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0ff04 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.759424:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787381473.759523:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1660097800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2157c09-10df-40cb-8228-ad4822122c97+13:2350:x1874205047039488:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 7299us (7722us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381473.759538:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 43 00010000:00010000:1.0:1787381473.759697:0:5790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0ff04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.759719:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0ff04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.759752:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0ff04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.759760:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0ff04 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.759768:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0ff04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.759774:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388c00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381473.759779:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0ff04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.759786:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0ff04 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.759805:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a1643af1600) 00010000:00010000:1.0:1787381473.759808:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787381473.759813:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0ff04 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.759830:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0ff04 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381473.759872:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1681723800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+12:10417:x1874205047039360:12345-192.168.203.22@tcp:55:lhsmtool_posix.0 Request processed in 32808us (33001us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787381473.759881:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 82 00000100:00100000:1.0:1787381473.770259:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381473.770326:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047039616 00000100:00100000:2.0:1787381473.770335:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047039616 00000100:00100000:2.0:1787381473.770397:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 32 00000100:00100000:2.0:1787381473.770408:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1660095880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2157c09-10df-40cb-8228-ad4822122c97+7:2350:x1874205047039616:12345-192.168.203.22@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787381473.770450:0:7779:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000021428048/0xbdc38ada7ea0ff0b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.770471:0:7779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b793ab2a/0xbdc38ada7ea0feef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537e4 expref: 7 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.770479:0:7779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787381473.770483:0:7779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787381473.770487:0:7779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021428048/0xbdc38ada7ea0ff0b lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.770536:0:7779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b793ab2a/0xbdc38ada7ea0feef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537e4 expref: 7 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.770551:0:7779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b793ab2a/0xbdc38ada7ea0feef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537e4 expref: 7 pid: 7779 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381473.770570:0:7779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16600c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7779:1874205065935744:192.168.203.22@tcp:104: 00000100:00100000:2.0:1787381473.770668:0:7779:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f94ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1787381473.775830:0:7779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16600c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7779:1874205065935744:192.168.203.22@tcp:104: 00010000:00010000:3.0:1787381473.775866:0:7779:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000021428048/0xbdc38ada7ea0ff0b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381473.781789:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381473.782262:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047039744 00000100:00100000:3.0:1787381473.782274:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047039744 00010000:00010000:3.0:1787381473.782313:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b793ab2a/0xbdc38ada7ea0feef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537e4 expref: 8 pid: 7779 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381473.782356:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 44 00000100:00100000:3.0:1787381473.782374:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1660094a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+8:2349:x1874205047039744:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787381473.782389:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787381473.782413:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b793ab2a/0xbdc38ada7ea0feef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537e4 expref: 8 pid: 7779 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.782429:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b793ab2a/0xbdc38ada7ea0feef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537e4 expref: 8 pid: 7779 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.782457:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b793ab2a/0xbdc38ada7ea0feef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537e4 expref: 8 pid: 7779 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.784227:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787381473.784238:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787381473.784247:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000021428048/0xbdc38ada7ea0ff0b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.784262:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021428048/0xbdc38ada7ea0ff0b lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.785654:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787381473.785733:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1660094a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+7:2349:x1874205047039744:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 3354us (3946us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381473.785746:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 44 00010000:00010000:2.0:1787381473.787879:0:7779:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000021428048/0xbdc38ada7ea0ff0b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.787901:0:7779:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021428048/0xbdc38ada7ea0ff0b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.787944:0:7779:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000021428048/0xbdc38ada7ea0ff0b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.787954:0:7779:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021428048/0xbdc38ada7ea0ff0b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.787964:0:7779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021428048/0xbdc38ada7ea0ff0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.787970:0:7779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681732a00 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:2.0:1787381473.787987:0:7779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021428048/0xbdc38ada7ea0ff0b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.788386:0:7779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021428048/0xbdc38ada7ea0ff0b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.788412:0:7779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021428048/0xbdc38ada7ea0ff0b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.788420:0:7779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021428048/0xbdc38ada7ea0ff0b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381473.788565:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1660095880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2157c09-10df-40cb-8228-ad4822122c97+6:2350:x1874205047039616:12345-192.168.203.22@tcp:1:lhsmtool_posix.0 Request processed in 18154us (18310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381473.788576:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 32 00000100:00100000:1.0:1787381473.798502:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381473.798640:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047040000 00000100:00100000:0.0:1787381473.798649:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047040000 00000100:00100000:0.0:1787381473.798709:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 83 00000100:00100000:0.0:1787381473.798719:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1660097100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+12:10417:x1874205047040000:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787381473.798810:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea0ff12 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381473.798829:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea0ff12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381473.798841:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea0ff12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381473.800376:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea0ff19 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381473.800401:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea0fecc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537cf expref: 13 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381473.800434:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea0ff19 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381473.800474:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea0fecc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537cf expref: 13 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381473.800490:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea0fecc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537cf expref: 13 pid: 5792 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381473.800507:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1681721880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1874205065935872:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787381473.800613:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f689e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787381473.803511:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1681721880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1874205065935872:192.168.203.22@tcp:104: 00010000:00010000:3.0:1787381473.803543:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea0ff19 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381473.811655:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381473.816729:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047040128 00000100:00100000:3.0:1787381473.816749:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047040128 00010000:00010000:2.0:1787381473.820441:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea0fecc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537cf expref: 14 pid: 5792 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381473.820507:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 45 00000100:00100000:2.0:1787381473.820519:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2157c09-10df-40cb-8228-ad4822122c97+14:2350:x1874205047040128:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787381473.820536:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381473.820543:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea0fecc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537cf expref: 14 pid: 5792 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.820557:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea0fecc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537cf expref: 14 pid: 5792 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.820597:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea0fecc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537cf expref: 14 pid: 5792 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.820614:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a1643af1600) 00010000:00010000:2.0:1787381473.820619:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea0ff19 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.820629:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea0ff19 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.820636:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea0ff19 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.820662:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787381473.820726:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2157c09-10df-40cb-8228-ad4822122c97+13:2350:x1874205047040128:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 210us (9083us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381473.820734:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 45 00010000:00010000:0.0:1787381473.820882:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea0ff19 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381473.820892:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea0ff19 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787381473.821114:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1787381473.821499:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1787381473.821546:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1787381473.821631:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1681720a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5791:1874205065936000:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787381473.821693:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381473.821726:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f689600 going to sleep for 11 seconds 00000100:00100000:2.0:1787381473.822651:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065936000 00000100:00100000:2.0:1787381473.822663:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065936000 00000100:00100000:2.0:1787381473.822714:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787381473.822722:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1681723100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5791:x1874205065936000:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787381473.822820:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1681723100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5791:x1874205065936000:12345-0@lo:1000:mdt00_001.0 Request processed in 99us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381473.822828:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787381473.823492:0:5791:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1787381473.823499:0:5791:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a167a804380, transno 4294967303 00000100:00100000:1.0:1787381473.823522:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1681720a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5791:1874205065936000:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1787381473.824965:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1787381473.825085:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1660096d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5791:1874205065936128:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787381473.825161:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381473.825189:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1642b90300 going to sleep for 11 seconds 00000100:00100000:2.0:1787381473.825532:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065936128 00000100:00100000:2.0:1787381473.825541:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065936128 00000100:00100000:2.0:1787381473.825598:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787381473.825608:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1660095c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5791:x1874205065936128:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787381473.825823:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1660095c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5791:x1874205065936128:12345-0@lo:1000:mdt00_001.0 Request processed in 216us (661us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787381473.825831:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787381473.825942:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1660096d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5791:1874205065936128:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1787381473.825979:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea0ff19 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.825990:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea0ff19 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.825999:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea0ff19 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.826235:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c9000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381473.826240:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea0ff19 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.826250:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea0ff19 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.826268:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a1643af1600) 00010000:00010000:1.0:1787381473.826271:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787381473.826285:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea0ff19 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.826291:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea0ff19 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.826329:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea0fe47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.826336:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea0fe47 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.826413:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea0fe47 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.826420:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb1a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381473.826423:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea0fe47 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.826429:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea0fe47 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.826439:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1643052500) 00010000:00010000:1.0:1787381473.826441:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787381473.826444:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea0fe47 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.826449:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea0fe47 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.826472:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0ff20 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.826486:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea0fe63 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537b3 expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.826502:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0ff20 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.826530:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea0fe63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537b3 expref: 16 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381473.826544:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea0fe63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537b3 expref: 16 pid: 5790 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381473.826557:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1660097b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1874205065936256:192.168.203.22@tcp:104: 00000100:00100000:1.0:1787381473.826674:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1642b90300 going to sleep for 11 seconds 00000100:00100000:1.0:1787381473.839222:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1660097b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1874205065936256:192.168.203.22@tcp:104: 00010000:00010000:1.0:1787381473.839251:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0ff20 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381473.844290:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381473.844797:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047040256 00000100:00100000:2.0:1787381473.844810:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047040256 00010000:00010000:2.0:1787381473.844866:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea0fe63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537b3 expref: 17 pid: 5790 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381473.844906:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00100000:2.0:1787381473.844916:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+17:2350:x1874205047040256:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787381473.844934:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381473.844941:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea0fe63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537b3 expref: 17 pid: 5790 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.844957:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea0fe63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537b3 expref: 17 pid: 5790 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.844982:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea0fe63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537b3 expref: 17 pid: 5790 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.845232:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1643052500) 00010000:00010000:2.0:1787381473.845240:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0ff20 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.845252:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0ff20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.845260:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0ff20 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.845321:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787381473.845385:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+16:2350:x1874205047040256:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 469us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381473.845394:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 46 00010000:00010000:2.0:1787381473.845728:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0ff20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.845738:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0ff20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.845750:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0ff20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.845758:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0ff20 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.845765:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0ff20 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.845771:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388c00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381473.845776:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0ff20 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.845784:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0ff20 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.845794:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1643052500) 00010000:00010000:2.0:1787381473.845797:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381473.845801:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0ff20 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.845992:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea0ff20 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.846106:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea0ff12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.846114:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea0ff12 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.846121:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea0ff12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.846470:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c9600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381473.846474:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea0ff12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.846482:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea0ff12 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.846493:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1643052500) 00010000:00010000:2.0:1787381473.846495:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787381473.846499:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea0ff12 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.846506:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea0ff12 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381473.846982:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1660097100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+15:10417:x1874205047040000:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 48258us (48485us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1787381473.846992:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 83 00000040:00080000:3.0:1787381473.848865:0:11528:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787381473.848875:0:11528:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787381473.848912:0:11528:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787381473.848919:0:11528:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000020:00080000:2.0:1787381473.849797:0:5791:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1787381473.857340:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381473.858170:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047040512 00000100:00100000:2.0:1787381473.858182:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047040512 00000100:00100000:2.0:1787381473.858260:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:2.0:1787381473.858270:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+15:10417:x1874205047040512:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787381473.858932:0:5793:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787381473.859076:0:5793:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1787381473.859124:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0ff27 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.859142:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0ff27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.859163:0:5793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0ff27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.859173:0:5793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0ff27 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.859180:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0ff27 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.859186:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0ff27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.859207:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787381473.859290:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1787381473.859296:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+17:10417:x1874205047040512:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 1024us (1963us total) trans 4294967362 rc 0/0 00010000:00010000:3.0:1787381473.859300:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0ff27 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381473.859309:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 20 00000020:00080000:2.0:1787381473.859314:0:5793:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787381473.859883:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681732a00 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:3.0:1787381473.859888:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0ff27 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.859897:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0ff27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.859910:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9a1650b8f500) 00010000:00010000:3.0:1787381473.859912:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787381473.859916:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0ff27 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381473.859921:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0ff27 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381473.861453:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381473.861467:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381473.861469:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787381474.035498:0:11842:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787381474.035508:0:11842:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787381474.035546:0:11842:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787381474.035552:0:11842:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787381474.124268:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f5c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065936384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787381474.124348:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381474.124431:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065936384 00000100:00100000:3.0:1787381474.124439:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065936384 00000100:00100000:3.0:1787381474.124482:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787381474.124491:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f5c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1874205065936384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787381474.124524:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787381474.124566:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f5c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1874205065936384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381474.124573:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787381474.125113:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f5c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065936384:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787381474.189098:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787381474.219689:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381474.220406:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047040768 00000100:00100000:3.0:1787381474.220418:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047040768 00000100:00100000:3.0:1787381474.220486:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 84 00000100:00100000:3.0:1787381474.220496:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f5c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+17:10427:x1874205047040768:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1787381474.221127:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381474.221160:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea0ff2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9537eb expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.224181:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0000/0xbdc38ada7ea0ff35 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.225321:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0000/0xbdc38ada7ea0ff35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.225334:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0000/0xbdc38ada7ea0ff35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787381474.225352:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000100:00080000:1.0:1787381474.225902:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787381474.227833:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea0ff2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537eb expref: 20 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.227874:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0000/0xbdc38ada7ea0ff35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537eb expref: 19 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.227884:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a1643052a00) 00010000:00010000:3.0:1787381474.227887:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787381474.227891:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb0000, rc 0) 00000100:00100000:3.0:1787381474.227967:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f5c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+19:10427:x1874205047040768:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 7472us (8287us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1787381474.227977:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 84 00000100:00100000:1.0:1787381474.237493:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381474.237530:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047040896 00000100:00100000:1.0:1787381474.237539:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047040896 00000100:00100000:1.0:1787381474.237586:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 85 00000100:00100000:1.0:1787381474.237594:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1660097b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+19:10427:x1874205047040896:12345-192.168.203.22@tcp:34:lfs.0 00010000:00010000:1.0:1787381474.237663:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0ff43 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.237688:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0ff43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.237778:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0ff43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.237796:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0ff4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.237804:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0ff4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.237810:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0ff4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.238385:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0ff51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.238461:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0ff51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.238471:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0ff51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787381474.238511:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0ff51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.238524:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0ff43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.238531:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0ff43 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.238547:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0ff43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.238553:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381474.238556:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0ff43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.238563:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0ff43 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.238575:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a1643052a00) 00010000:00010000:1.0:1787381474.238578:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381474.238582:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0ff43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.238588:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea0ff43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.238600:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0ff4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.238606:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0ff4a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.238610:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0ff4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.238615:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381474.238617:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0ff4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.238634:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0ff4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.238641:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a1659f89800) 00010000:00010000:1.0:1787381474.238643:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381474.238646:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0ff4a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.238652:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0ff4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.238664:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0ff51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.238670:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0ff51 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.238676:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0ff51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.238681:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541389a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381474.238684:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0ff51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.238689:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0ff51 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.238783:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1659f89f00) 00010000:00010000:1.0:1787381474.238786:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381474.238790:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0ff51 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.238805:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0ff51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381474.239863:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1660097b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+19:10427:x1874205047040896:12345-192.168.203.22@tcp:34:lfs.0 Request processed in 2262us (2372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381474.239875:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 85 00000100:00100000:1.0:1787381474.308108:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381474.308288:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047041152 00000100:00100000:2.0:1787381474.308299:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047041152 00000100:00100000:2.0:1787381474.308361:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 86 00000100:00100000:2.0:1787381474.308371:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1660096a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+19:10430:x1874205047041152:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1787381474.308394:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381474.308420:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0ff58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9537f2 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.308491:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0ff5f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.308505:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0ff5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.308516:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0ff5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.308531:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0ff66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.308538:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0ff66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.308545:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0ff66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.310341:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0ff6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.310368:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0ff6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.310379:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0ff6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787381474.310392:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1787381474.310659:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0ff5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.310668:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0ff5f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.310675:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0ff5f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.310681:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681733200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381474.310685:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0ff5f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.310692:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0ff5f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.310705:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a1643052a00) 00010000:00010000:2.0:1787381474.310709:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381474.310712:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0ff5f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.310789:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0ff5f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.310804:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0ff66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.310817:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0ff66 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.310824:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0ff66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.310829:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681733000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381474.310832:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0ff66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.310839:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0ff66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.310849:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a1650b8fb00) 00010000:00010000:2.0:1787381474.310852:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381474.310854:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0ff66 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.310860:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0ff66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.310910:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0ff58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537f2 expref: 22 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.310925:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0ff6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537f2 expref: 21 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.310933:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1650b8fc00) 00010000:00010000:2.0:1787381474.310936:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787381474.310945:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1681733400, rc 0) 00000100:00100000:2.0:1787381474.311186:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1660096a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+21:10430:x1874205047041152:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 2814us (3084us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1787381474.311195:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 86 00000100:00100000:2.0:1787381474.329978:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381474.330182:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047041280 00000100:00100000:3.0:1787381474.330192:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047041280 00000100:00100000:3.0:1787381474.330258:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 87 00000100:00100000:3.0:1787381474.330268:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+21:10430:x1874205047041280:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:3.0:1787381474.330352:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea0ff7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.330378:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea0ff7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.330390:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea0ff7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.330417:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea0ff7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.330424:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea0ff7b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.330456:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea0ff7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.330462:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb1400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381474.330466:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea0ff7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.330474:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea0ff7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.330487:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1650b8fc00) 00010000:00010000:3.0:1787381474.330490:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787381474.330494:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea0ff7b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.330500:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea0ff7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381474.330592:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+21:10430:x1874205047041280:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 324us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381474.330600:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 87 00000100:00100000:0.0:1787381474.335227:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381474.335576:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047041536 00000100:00100000:2.0:1787381474.335588:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047041536 00000100:00100000:2.0:1787381474.335657:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:2.0:1787381474.335667:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166d3b9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+21:10430:x1874205047041536:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:2.0:1787381474.335915:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166d3b9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+22:10430:x1874205047041536:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 248us (696us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1787381474.335924:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:2.0:1787381474.390091:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381474.390258:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047041792 00000100:00100000:1.0:1787381474.390269:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047041792 00000100:00100000:1.0:1787381474.390326:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 88 00000100:00100000:1.0:1787381474.390335:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+22:9961:x1874205047041792:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:1.0:1787381474.390359:0:11324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381474.390378:0:11324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0ff82 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9537f9 expref: -99 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.390476:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0ff89 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.390491:0:11324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0ff6d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537f2 expref: 23 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.390510:0:11324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0ff89 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.390544:0:11324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0ff6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537f2 expref: 23 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.390556:0:11324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0ff6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537f2 expref: 23 pid: 5791 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381474.390583:0:11324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1660094e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11324:1874205065936512:192.168.203.22@tcp:104: 00000100:00100000:1.0:1787381474.390686:0:11324:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1646e78780 going to sleep for 11 seconds 00000100:00100000:1.0:1787381474.393259:0:11324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1660094e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11324:1874205065936512:192.168.203.22@tcp:104: 00010000:00010000:1.0:1787381474.393286:0:11324:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0ff89 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381474.396222:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381474.396990:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047041920 00000100:00100000:1.0:1787381474.397000:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047041920 00010000:00010000:0.0:1787381474.397540:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0ff6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537f2 expref: 24 pid: 5791 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381474.397616:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:0.0:1787381474.397637:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+24:2350:x1874205047041920:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787381474.397653:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787381474.397660:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0ff6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537f2 expref: 24 pid: 5791 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.397674:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0ff6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537f2 expref: 24 pid: 5791 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.397695:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0ff6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537f2 expref: 24 pid: 5791 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.397709:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1650b8fc00) 00010000:00010000:0.0:1787381474.397713:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0ff89 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.397722:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0ff89 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.397730:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0ff89 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.397760:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787381474.397907:0:11324:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0ff89 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.397916:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0ff89 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787381474.397936:0:11324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1787381474.398117:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea0ff82 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537f9 expref: 25 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.398132:0:11324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0ff89 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537f9 expref: 24 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.398140:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1650b8fc00) 00010000:00010000:1.0:1787381474.398142:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787381474.398156:0:11324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541388800, rc 0) 00000100:00100000:0.0:1787381474.398837:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+24:2350:x1874205047041920:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 1198us (2621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381474.398849:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:1.0:1787381474.399122:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+23:9961:x1874205047041792:12345-192.168.203.22@tcp:101:bash.0 Request processed in 8787us (9039us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1787381474.399131:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 88 00000100:00100000:3.0:1787381474.402524:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381474.402628:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047042176 00000100:00100000:2.0:1787381474.402637:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047042176 00000100:00100000:2.0:1787381474.402730:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 89 00000100:00100000:2.0:1787381474.402741:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f5c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+23:9961:x1874205047042176:12345-192.168.203.22@tcp:36:bash.0 00010000:00010000:2.0:1787381474.405285:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0ff97 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.405372:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0ff97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.405385:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0ff97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787381474.405460:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1787381474.405498:0:5791:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009d939971 reply state 00000000b61799b3 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0ff97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381474.405508:0:5791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787381474.405567:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1787381474.405697:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f5c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+27:9961:x1874205047042176:12345-192.168.203.22@tcp:36:bash.0 Request processed in 2953us (3180us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1787381474.405705:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 89 00000020:00080000:2.0:1787381474.405710:0:5791:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787381474.408793:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381474.409377:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047042304 00000100:00100000:1.0:1787381474.409387:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047042304 00000100:00100000:1.0:1787381474.409440:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 90 00000100:00100000:1.0:1787381474.409449:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1681722d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+27:9961:x1874205047042304:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:1.0:1787381474.409473:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381474.409492:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0ff9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953800 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.409548:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0ff9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953800 expref: 28 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.409562:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0ff9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953800 expref: 28 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.409581:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1650b8fc00) 00010000:00010000:1.0:1787381474.409584:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787381474.409587:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541389e00, rc 0) 00000100:00100000:1.0:1787381474.409645:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1681722d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+28:9961:x1874205047042304:12345-192.168.203.22@tcp:101:bash.0 Request processed in 196us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381474.409653:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 90 00000100:00100000:1.0:1787381474.412626:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381474.412704:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047042432 00000100:00100000:3.0:1787381474.412715:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047042432 00000100:00100000:3.0:1787381474.412772:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 33 00000100:00100000:3.0:1787381474.412782:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1660094e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2157c09-10df-40cb-8228-ad4822122c97+6:9961:x1874205047042432:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:3.0:1787381474.412800:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381474.412827:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dbe3b62/0xbdc38ada7ea0ffa5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953807 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787381474.412872:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8946df, atime: 0x6a8946dd, ctime: 0x6a8946df, blocks: 0xb 00010000:00010000:3.0:1787381474.412895:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=332s v=(0 0) 00010000:00010000:3.0:1787381474.412900:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787381474.412908:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dbe3b62/0xbdc38ada7ea0ffa5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953807 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.412926:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002dbe3b62/0xbdc38ada7ea0ffa5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953807 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.412939:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb0a00, rc 0) 00000100:00100000:3.0:1787381474.413035:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1660094e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2157c09-10df-40cb-8228-ad4822122c97+7:9961:x1874205047042432:12345-192.168.203.22@tcp:101:bash.0 Request processed in 225us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381474.413041:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 33 00000100:00100000:1.0:1787381474.415726:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381474.415806:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047042560 00000100:00100000:0.0:1787381474.415826:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047042560 00002000:00010000:0.0:1787381474.415867:0:6593:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1787381474.415883:0:6593:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a1660095180 with x1874205047042560 ext(0->18446744073709551615) 00002000:00010000:0.0:1787381474.415893:0:6593:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a1660095180. 00000100:00100000:0.0:1787381474.415927:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:0.0:1787381474.415935:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1660095180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f2157c09-10df-40cb-8228-ad4822122c97+7:2349:x1874205047042560:12345-192.168.203.22@tcp:10:bash.0 00002000:00010000:0.0:1787381474.416237:0:6593:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787381474.416241:0:6593:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787381471 -> 1787381473 00002000:00010000:0.0:1787381474.416244:0:6593:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1787381469 -> 1787381469 00002000:00010000:0.0:1787381474.416246:0:6593:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787381471 -> 1787381473 00002000:00010000:0.0:1787381474.416248:0:6593:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787381474.416302:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1660095180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f2157c09-10df-40cb-8228-ad4822122c97+8:2349:x1874205047042560:12345-192.168.203.22@tcp:10:bash.0 Request processed in 367us (583us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787381474.416320:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 1 00002000:00010000:0.0:1787381474.416324:0:6593:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1787381474.416326:0:6593:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a1660095180 with x1874205047042560 ext(0->18446744073709551615) 00002000:00010000:0.0:1787381474.416331:0:6593:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a1660095180. 00010000:00010000:2.0:1787381474.418210:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0ff97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.418226:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0ff97 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.418234:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0ff97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.418239:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681733000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381474.418243:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0ff97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.418251:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0ff97 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.418268:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1650b8fc00) 00010000:00010000:2.0:1787381474.418271:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381474.418276:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0ff97 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.418282:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0ff97 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381474.515130:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381474.515247:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047042688 00000100:00100000:2.0:1787381474.515258:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047042688 00000100:00100000:2.0:1787381474.515566:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 91 00000100:00100000:2.0:1787381474.515578:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1660094380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+27:10444:x1874205047042688:12345-192.168.203.22@tcp:34:lfs.0 00010000:00010000:2.0:1787381474.515661:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0ffac lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.515680:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0ffac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.515692:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0ffac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.515708:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0ffb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.515716:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0ffb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.515723:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0ffb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.516103:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0ffba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.516115:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0ffba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.516123:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0ffba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787381474.516185:0:11324:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0ffba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.516197:0:11324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0ffac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.516204:0:11324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0ffac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.516210:0:11324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0ffac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.516511:0:11324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681733000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381474.516516:0:11324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0ffac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.516524:0:11324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0ffac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.516536:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a1643052a00) 00010000:00010000:2.0:1787381474.516539:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381474.516544:0:11324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0ffac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.516551:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0ffac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.516565:0:11324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0ffb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.516572:0:11324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0ffb3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.516584:0:11324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0ffb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.516589:0:11324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681733200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381474.516592:0:11324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0ffb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.516598:0:11324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0ffb3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.516607:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a1650b8fb00) 00010000:00010000:2.0:1787381474.516610:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381474.516613:0:11324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0ffb3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.516619:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0ffb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.516634:0:11324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0ffba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.516640:0:11324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0ffba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.516645:0:11324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0ffba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.516650:0:11324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681733400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381474.516653:0:11324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0ffba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.516669:0:11324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0ffba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.516678:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1650b8fc00) 00010000:00010000:2.0:1787381474.516681:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381474.516684:0:11324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0ffba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.516689:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0ffba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381474.516828:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1660094380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+27:10444:x1874205047042688:12345-192.168.203.22@tcp:34:lfs.0 Request processed in 1250us (1706us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381474.516837:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 91 00000100:00100000:1.0:1787381474.563118:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381474.563200:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047042944 00000100:00100000:2.0:1787381474.563211:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047042944 00000100:00100000:2.0:1787381474.563270:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 92 00000100:00100000:2.0:1787381474.563280:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1660096680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+27:10447:x1874205047042944:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1787381474.563303:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381474.563324:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0ffc1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a95380e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.563410:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0ffc8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.563428:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0ffc8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.563440:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0ffc8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.563976:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8000/0xbdc38ada7ea0ffcf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.563987:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8000/0xbdc38ada7ea0ffcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.563995:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8000/0xbdc38ada7ea0ffcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.564372:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9800/0xbdc38ada7ea0ffd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.564383:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9800/0xbdc38ada7ea0ffd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.564396:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9800/0xbdc38ada7ea0ffd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787381474.564406:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787381474.564508:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0ffc8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.564516:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0ffc8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.564522:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0ffc8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.564528:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681733200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787381474.564532:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0ffc8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.564539:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0ffc8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.564551:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a1643052a00) 00010000:00010000:0.0:1787381474.564554:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787381474.564558:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0ffc8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.564565:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea0ffc8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.564576:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8000/0xbdc38ada7ea0ffcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.564581:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8000/0xbdc38ada7ea0ffcf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.564593:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8000/0xbdc38ada7ea0ffcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.564598:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c8000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787381474.564600:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8000/0xbdc38ada7ea0ffcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.564606:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8000/0xbdc38ada7ea0ffcf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.564613:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a1643af1700) 00010000:00010000:0.0:1787381474.564615:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787381474.564618:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8000/0xbdc38ada7ea0ffcf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.564623:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8000/0xbdc38ada7ea0ffcf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.565094:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea0ffc1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95380e expref: 30 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.565113:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9800/0xbdc38ada7ea0ffd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95380e expref: 29 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.565122:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1650b8fc00) 00010000:00010000:0.0:1787381474.565124:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787381474.565127:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16460c9800, rc 0) 00000100:00100000:0.0:1787381474.565212:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1660096680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+29:10447:x1874205047042944:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 1933us (2104us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1787381474.565231:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 92 00000100:00100000:1.0:1787381474.569087:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381474.569320:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047043072 00000100:00100000:0.0:1787381474.569331:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047043072 00000100:00100000:0.0:1787381474.569388:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 93 00000100:00100000:0.0:1787381474.569398:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1660097480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+29:10447:x1874205047043072:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:0.0:1787381474.569466:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea0ffe4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.569484:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0ff89 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537f9 expref: 29 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.569492:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea0ffe4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.569527:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0ff89 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537f9 expref: 29 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.569540:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0ff89 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537f9 expref: 29 pid: 11324 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381474.569555:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1681721c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1874205065936640:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787381474.569639:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f689780 going to sleep for 11 seconds 00000100:00100000:0.0:1787381474.572473:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1681721c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1874205065936640:192.168.203.22@tcp:104: 00010000:00010000:0.0:1787381474.572502:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea0ffe4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381474.580769:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381474.587413:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047043328 00000100:00100000:2.0:1787381474.587427:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047043328 00000100:00100000:2.0:1787381474.587496:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:2.0:1787381474.587506:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1660095500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+30:5564:x1874205047043328:12345-192.168.203.22@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787381474.588089:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1660095500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+31:5564:x1874205047043328:12345-192.168.203.22@tcp:35:ldlm_bl.0 Request processed in 583us (7328us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1787381474.588098:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:1.0:1787381474.597887:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381474.598047:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047043456 00000100:00100000:3.0:1787381474.598067:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047043456 00010000:00010000:3.0:1787381474.598112:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0ff89 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537f9 expref: 31 pid: 11324 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381474.598161:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 48 00000100:00100000:3.0:1787381474.598175:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f932d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2157c09-10df-40cb-8228-ad4822122c97+31:2350:x1874205047043456:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787381474.598190:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787381474.598198:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0ff89 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537f9 expref: 31 pid: 11324 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.598211:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0ff89 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537f9 expref: 31 pid: 11324 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.598249:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea0ff89 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9537f9 expref: 31 pid: 11324 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.598265:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1650b8fc00) 00010000:00010000:3.0:1787381474.598270:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea0ffe4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.598278:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea0ffe4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.598285:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea0ffe4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.598317:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787381474.598377:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f932d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2157c09-10df-40cb-8228-ad4822122c97+30:2350:x1874205047043456:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 206us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381474.598384:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 48 00010000:00010000:0.0:1787381474.598517:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea0ffe4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.598532:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea0ffe4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.598566:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea0ffe4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.598574:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea0ffe4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.598580:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea0ffe4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.598586:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c9e00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787381474.598590:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea0ffe4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.598597:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea0ffe4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.598606:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1650b8fc00) 00010000:00010000:0.0:1787381474.598609:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787381474.598612:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea0ffe4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.598618:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea0ffe4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381474.598675:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1660097480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+29:10447:x1874205047043072:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 29278us (29596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381474.598684:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 93 00000100:00100000:3.0:1787381474.606398:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381474.606556:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047043712 00000100:00100000:2.0:1787381474.606567:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047043712 00000100:00100000:2.0:1787381474.606628:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:2.0:1787381474.606639:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f5c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+29:10447:x1874205047043712:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:2.0:1787381474.607125:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f5c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+30:10447:x1874205047043712:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 367us (615us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1787381474.607135:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:1.0:1787381474.734903:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381474.735330:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047043968 00000100:00100000:2.0:1787381474.735342:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047043968 00000100:00100000:2.0:1787381474.735411:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 94 00000100:00100000:2.0:1787381474.735424:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f931c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+30:10458:x1874205047043968:12345-192.168.203.22@tcp:101:cat.0 00010000:00010000:2.0:1787381474.735448:0:11324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381474.735469:0:11324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0ffeb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953815 expref: -99 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.735542:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fff2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.735568:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fff2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.735578:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fff2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.735594:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fff9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.735601:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fff9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.735607:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fff9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.739458:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea10000 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.739483:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea10000 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.739496:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea10000 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787381474.739509:0:11324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1787381474.740698:0:11324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fff2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.740857:0:11324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fff2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.740865:0:11324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fff2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.740871:0:11324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681732800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381474.740876:0:11324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fff2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.740883:0:11324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fff2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.740897:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a1643052a00) 00010000:00010000:3.0:1787381474.740900:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381474.740904:0:11324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fff2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.740910:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea0fff2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.740926:0:11324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fff9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.740932:0:11324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fff9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.740937:0:11324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fff9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.740943:0:11324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681732a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381474.740952:0:11324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fff9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.740958:0:11324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fff9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.740965:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a1650b8fb00) 00010000:00010000:3.0:1787381474.740967:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381474.740970:0:11324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fff9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.740975:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea0fff9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.741547:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea0ffeb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953815 expref: 33 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.741568:0:11324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea10000 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953815 expref: 32 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.741576:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1650b8fc00) 00010000:00010000:3.0:1787381474.741578:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787381474.741581:0:11324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb1400, rc 0) 00000100:00100000:3.0:1787381474.741654:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f931c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+32:10458:x1874205047043968:12345-192.168.203.22@tcp:101:cat.0 Request processed in 6232us (6759us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1787381474.741663:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 94 00000100:00100000:0.0:1787381474.756818:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381474.756971:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047044224 00000100:00100000:2.0:1787381474.756982:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047044224 00000100:00100000:2.0:1787381474.757074:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 24 00000100:00100000:2.0:1787381474.757083:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1681721c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+32:10458:x1874205047044224:12345-192.168.203.22@tcp:35:cat.0 00000100:00100000:2.0:1787381474.757342:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1681721c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+33:10458:x1874205047044224:12345-192.168.203.22@tcp:35:cat.0 Request processed in 258us (532us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1787381474.757350:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 24 00000100:00100000:0.0:1787381474.781106:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381474.781203:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047044480 00000100:00100000:1.0:1787381474.781211:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047044480 00000100:00100000:1.0:1787381474.781267:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 95 00000100:00100000:1.0:1787381474.781275:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1681723b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+33:10459:x1874205047044480:12345-192.168.203.22@tcp:36:rm.0 00010000:00010000:1.0:1787381474.781416:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787381474.781456:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea10000 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953815 expref: 33 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.781481:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9800/0xbdc38ada7ea0ffd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95380e expref: 32 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.781494:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea0ff9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953800 expref: 31 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.781666:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1650b8fc00) 00010000:00010000:1.0:1787381474.781677:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787381474.781698:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea1000e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.781711:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea1000e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.781721:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea1000e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.781735:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea10015 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.781741:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea10015 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.781769:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea10015 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.782102:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea1001c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.782111:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea1001c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.782118:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea1001c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787381474.783251:0:5791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1787381474.783264:0:5791:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 332914258553ns, next at 333914256086ns, rc = 0 00010000:00010000:1.0:1787381474.783920:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10023 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.783937:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10023 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.783947:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10023 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.783955:0:5791:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10023 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.783961:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10023 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.783966:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10023 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.784041:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787381474.784068:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea1001c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.784075:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea1001c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.784082:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea1001c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.784087:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541389800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381474.784091:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea1001c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.784099:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea1001c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.784111:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1659f89800) 00010000:00010000:1.0:1787381474.784114:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787381474.784118:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea1001c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.784125:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea1001c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.784158:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea1000e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.784165:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea1000e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.784172:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea1000e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.784183:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541389600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381474.784186:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea1000e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.784192:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea1000e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.784200:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a1643052a00) 00010000:00010000:1.0:1787381474.784202:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381474.784205:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea1000e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.784211:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea1000e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787381474.784221:0:5791:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000912a351b reply state 00000000fdadac1e transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea10015 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381474.784229:0:5791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787381474.784344:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1681723b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+32:10459:x1874205047044480:12345-192.168.203.22@tcp:36:rm.0 Request processed in 3052us (3230us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1787381474.784354:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 95 00010000:00010000:2.0:1787381474.785985:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787381474.785996:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10023 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.786049:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388800 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:2.0:1787381474.786053:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10023 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.786080:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10023 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.786094:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9a1659f89800) 00010000:00010000:2.0:1787381474.786097:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787381474.786102:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10023 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.786108:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10023 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381474.786128:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381474.786129:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381474.786131:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381474.789940:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea10015 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.789967:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea10015 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.789975:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea10015 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.789982:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541389c00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787381474.789987:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea10015 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.789995:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea10015 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.790052:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a1659f89f00) 00010000:00010000:0.0:1787381474.790055:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787381474.790060:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea10015 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.790067:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea10015 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381474.852688:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381474.855300:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047044736 00000100:00100000:1.0:1787381474.855316:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047044736 00000100:00100000:1.0:1787381474.855456:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 96 00000100:00100000:1.0:1787381474.855467:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1681722a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+31:10465:x1874205047044736:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:1.0:1787381474.855493:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381474.856309:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea1002a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a95381c expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.856444:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea10031 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.856473:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea10031 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.856484:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea10031 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.856500:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8600/0xbdc38ada7ea10038 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.856506:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8600/0xbdc38ada7ea10038 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.856523:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8600/0xbdc38ada7ea10038 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787381474.857064:0:8469:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1787381474.857364:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea1003f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.857375:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea1003f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.857384:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea1003f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.857420:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea10031 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.857427:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea10031 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.857433:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea10031 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.857446:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c9600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787381474.857451:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea10031 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.857458:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea10031 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.857470:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a1643052a00) 00010000:00010000:0.0:1787381474.857474:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787381474.857478:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea10031 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.857484:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea10031 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787381474.857498:0:8469:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c34c5400 reply state 00000000b60da376 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8600/0xbdc38ada7ea10038 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381474.858270:0:8469:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787381474.858314:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea1002a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95381c expref: 34 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.858334:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea1003f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95381c expref: 33 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.858343:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a1643af1f00) 00010000:00010000:0.0:1787381474.858346:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787381474.858349:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16460c9400, rc 0) 00000100:00100000:0.0:1787381474.858561:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1681722a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+34:10465:x1874205047044736:12345-192.168.203.22@tcp:101:bash.0 Request processed in 3095us (5880us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1787381474.858579:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 96 00010000:00010000:3.0:1787381474.867300:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8600/0xbdc38ada7ea10038 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.867319:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8600/0xbdc38ada7ea10038 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.867343:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8600/0xbdc38ada7ea10038 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.867349:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c8600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381474.867354:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8600/0xbdc38ada7ea10038 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.867362:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8600/0xbdc38ada7ea10038 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.867379:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a1643af1700) 00010000:00010000:3.0:1787381474.867382:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381474.867385:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8600/0xbdc38ada7ea10038 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.867390:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8600/0xbdc38ada7ea10038 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381474.868383:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381474.868450:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047044864 00000100:00100000:3.0:1787381474.868461:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047044864 00000100:00100000:3.0:1787381474.868528:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 34 00000100:00100000:3.0:1787381474.868539:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1681720e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2157c09-10df-40cb-8228-ad4822122c97+7:2351:x1874205047044864:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:3.0:1787381474.868555:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381474.868574:0:6587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041aa0842/0xbdc38ada7ea1004d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953823 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787381474.868601:0:6587:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787381474.868620:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=332s v=(0 0) 00010000:00010000:3.0:1787381474.868634:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787381474.868644:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041aa0842/0xbdc38ada7ea1004d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953823 expref: 8 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.868664:0:6587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000041aa0842/0xbdc38ada7ea1004d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953823 expref: 8 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.868678:0:6587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb1c00, rc 0) 00000100:00100000:3.0:1787381474.868736:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1681720e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2157c09-10df-40cb-8228-ad4822122c97+8:2351:x1874205047044864:12345-192.168.203.22@tcp:101:bash.0 Request processed in 197us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381474.868743:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 34 00000100:00080000:2.0:1787381474.868933:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787381474.872301:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381474.872380:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047044992 00000100:00100000:3.0:1787381474.872389:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047044992 00000100:00100000:3.0:1787381474.872455:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 35 00000100:00100000:3.0:1787381474.872465:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1681721180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2157c09-10df-40cb-8228-ad4822122c97+8:10465:x1874205047044992:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:3.0:1787381474.872481:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381474.872497:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da9994f5/0xbdc38ada7ea10054 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a95382a expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.872622:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000041aa0842/0xbdc38ada7ea1004d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953823 expref: 9 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.872632:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787381474.872636:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787381474.872641:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da9994f5/0xbdc38ada7ea10054 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95382a expref: 9 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.872690:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000041aa0842/0xbdc38ada7ea1004d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953823 expref: 9 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381474.872703:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000041aa0842/0xbdc38ada7ea1004d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953823 expref: 9 pid: 6587 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381474.872717:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f5c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6590:1874205065936768:192.168.203.22@tcp:104: 00000100:00100000:3.0:1787381474.872805:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1647423000 going to sleep for 11 seconds 00000100:00100000:3.0:1787381474.876936:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381474.877072:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047045120 00000100:00100000:1.0:1787381474.877081:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047045120 00010000:00010000:1.0:1787381474.877156:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000041aa0842/0xbdc38ada7ea1004d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953823 expref: 10 pid: 6587 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381474.877194:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 49 00000100:00100000:1.0:1787381474.877205:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1665876850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+10:2350:x1874205047045120:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787381474.877221:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381474.877244:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000041aa0842/0xbdc38ada7ea1004d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953823 expref: 10 pid: 6587 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.877258:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000041aa0842/0xbdc38ada7ea1004d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953823 expref: 10 pid: 6587 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.877285:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787381474.877291:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787381474.877299:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000da9994f5/0xbdc38ada7ea10054 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95382a expref: 10 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.877309:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da9994f5/0xbdc38ada7ea10054 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95382a expref: 10 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381474.877347:0:5775:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000da9994f5/0xbdc38ada7ea10054 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95382a expref: 10 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381474.877360:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f930a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5775:1874205065936896:192.168.203.22@tcp:105: 00000100:00100000:1.0:1787381474.877453:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1643c47600 going to sleep for 11 seconds 00010000:00010000:0.0:1787381474.882334:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041aa0842/0xbdc38ada7ea1004d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953823 expref: 10 pid: 6587 timeout: 433 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381474.882359:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f5c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6590:1874205065936768:192.168.203.22@tcp:104: 00010000:00010000:0.0:1787381474.882393:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000da9994f5/0xbdc38ada7ea10054 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc01952459a95382a expref: 9 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381474.882418:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb0200, rc 0) 00000100:00100000:0.0:1787381474.882493:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1681721180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2157c09-10df-40cb-8228-ad4822122c97+9:10465:x1874205047044992:12345-192.168.203.22@tcp:101:bash.0 Request processed in 10029us (10200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381474.882503:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 35 00000100:00100000:0.0:1787381474.883506:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f930a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5775:1874205065936896:192.168.203.22@tcp:105: 00010000:00010000:0.0:1787381474.883525:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787381474.883577:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1665876850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+8:2350:x1874205047045120:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 6373us (6651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381474.883588:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 49 00000100:00100000:3.0:1787381474.888321:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381474.888430:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047045376 00000100:00100000:2.0:1787381474.888441:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047045376 00000100:00100000:2.0:1787381474.888504:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:2.0:1787381474.888515:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f5c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+33:10465:x1874205047045376:12345-192.168.203.22@tcp:35:bash.0 00000100:00100000:2.0:1787381474.888876:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f5c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+34:10465:x1874205047045376:12345-192.168.203.22@tcp:35:bash.0 Request processed in 361us (562us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1787381474.888885:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 25 00000040:00080000:3.0:1787381474.892246:0:11528:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787381474.892256:0:11528:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787381474.892289:0:11528:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787381474.892296:0:11528:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787381475.132112:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381475.132314:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047045504 00000100:00100000:3.0:1787381475.132325:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047045504 00000100:00100000:3.0:1787381475.132440:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 97 00000100:00100000:3.0:1787381475.132450:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f931180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+34:10481:x1874205047045504:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1787381475.132476:0:11324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381475.132499:0:11324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea1005b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953831 expref: -99 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.132572:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea10062 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.132585:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea10062 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.132607:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea10062 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787381475.132682:0:11324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1787381475.132687:0:11324:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787381475.132711:0:11324:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea10062 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.132736:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea1005b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953831 expref: 36 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.132756:0:11324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea10062 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953831 expref: 35 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.132765:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a1643052a00) 00010000:00010000:3.0:1787381475.132768:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787381475.132772:0:11324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb0800, rc 0) 00000100:00100000:3.0:1787381475.132940:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f931180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+35:10481:x1874205047045504:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 491us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381475.132948:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 97 00000100:00100000:3.0:1787381475.138890:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381475.139693:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047045760 00000100:00100000:0.0:1787381475.139705:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047045760 00000100:00100000:0.0:1787381475.139768:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 98 00000100:00100000:0.0:1787381475.139779:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f5c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+35:10481:x1874205047045760:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1787381475.139799:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381475.139834:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea10069 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953838 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.139933:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea10070 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.139948:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea10070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.139960:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea10070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787381475.139971:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787381475.140573:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea10069 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953838 expref: 38 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.140594:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea10070 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953838 expref: 37 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.140601:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a1643af1f00) 00010000:00010000:0.0:1787381475.140604:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787381475.140607:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16460c8a00, rc 0) 00000100:00100000:0.0:1787381475.140686:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f5c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+37:10481:x1874205047045760:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 909us (1804us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1787381475.140693:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 98 00000100:00100000:3.0:1787381475.144851:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381475.145024:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047046016 00000100:00100000:0.0:1787381475.145034:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047046016 00000100:00100000:0.0:1787381475.145089:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 99 00000100:00100000:0.0:1787381475.145108:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1644e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+37:10481:x1874205047046016:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1787381475.145155:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381475.145176:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea1007e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a95383f expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.145269:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10085 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.145283:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10085 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.145294:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10085 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787381475.145321:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787381475.145458:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea1007e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95383f expref: 40 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.145476:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10085 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95383f expref: 39 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.145484:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a1643af1f00) 00010000:00010000:0.0:1787381475.145487:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787381475.145490:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16460c8800, rc 0) 00000100:00100000:0.0:1787381475.145545:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1644e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+39:10481:x1874205047046016:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 449us (704us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1787381475.145552:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 99 00000100:00100000:3.0:1787381475.146566:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381475.151074:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047046144 00000100:00100000:2.0:1787381475.151088:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047046144 00000100:00100000:2.0:1787381475.151186:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:2.0:1787381475.151197:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+39:2352:x1874205047046144:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787381475.151212:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381475.151237:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea10070 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953838 expref: 39 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.151269:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a1643af1f00) 00010000:00010000:2.0:1787381475.151274:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787381475.151361:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+38:2352:x1874205047046144:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 165us (4798us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381475.151369:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:2.0:1787381475.156113:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381475.156316:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047046272 00000100:00100000:3.0:1787381475.156331:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047046272 00000100:00100000:3.0:1787381475.156379:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 36 00000100:00100000:3.0:1787381475.156397:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2157c09-10df-40cb-8228-ad4822122c97+8:2352:x1874205047046272:12345-192.168.203.22@tcp:1:lfs.0 00010000:00010000:3.0:1787381475.156455:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d520c514/0xbdc38ada7ea10093 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.156474:0:6587:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000da9994f5/0xbdc38ada7ea10054 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc01952459a95382a expref: 8 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.156482:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787381475.156485:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787381475.156489:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d520c514/0xbdc38ada7ea10093 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.156521:0:6587:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000da9994f5/0xbdc38ada7ea10054 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.22@tcp remote: 0xc01952459a95382a expref: 8 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.156535:0:6587:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000da9994f5/0xbdc38ada7ea10054 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a95382a expref: 8 pid: 6590 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381475.156548:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6587:1874205065937024:192.168.203.22@tcp:104: 00000100:00100000:3.0:1787381475.156635:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1647423540 going to sleep for 11 seconds 00000100:00100000:2.0:1787381475.164935:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381475.167455:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047046400 00000100:00100000:0.0:1787381475.167472:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047046400 00002000:00100000:0.0:1787381475.167529:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9a16600c6300 x1874205047046400/t0(0) o4->f2157c09-10df-40cb-8228-ad4822122c97@192.168.203.22@tcp:526/0 lens 504/0 e 0 to 0 dl 1787381486 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787381475.167554:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a16600c6300 with x1874205047046400 ext(0->8) 00010000:00010000:0.0:1787381475.167566:0:6594:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000da9994f5/0xbdc38ada7ea10054 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a95382a expref: 9 pid: 6590 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.167583:0:6594:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000da9994f5/0xbdc38ada7ea10054 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a95382a expref: 9 pid: 6590 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787381475.167593:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a16600c6300 00000100:00100000:0.0:1787381475.167701:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:0.0:1787381475.167712:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f2157c09-10df-40cb-8228-ad4822122c97+9:2349:x1874205047046400:12345-192.168.203.22@tcp:4:lfs.0 00000100:00100000:0.0:1787381475.168277:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f2157c09-10df-40cb-8228-ad4822122c97+11:2349:x1874205047046400:12345-192.168.203.22@tcp:4:lfs.0 Request processed in 564us (3349us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787381475.168286:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 1 00002000:00100000:0.0:1787381475.168294:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9a16600c6300 x1874205047046400/t4294967302(0) o4->f2157c09-10df-40cb-8228-ad4822122c97@192.168.203.22@tcp:526/0 lens 504/448 e 0 to 0 dl 1787381486 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787381475.168303:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a16600c6300 with x1874205047046400 ext(0->8) 00010000:00010000:0.0:1787381475.168309:0:6594:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000da9994f5/0xbdc38ada7ea10054 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a95382a expref: 11 pid: 6590 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.168321:0:6594:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000da9994f5/0xbdc38ada7ea10054 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a95382a expref: 11 pid: 6590 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787381475.168338:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a16600c6300 00000100:00100000:3.0:1787381475.175042:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6587:1874205065937024:192.168.203.22@tcp:104: 00010000:00010000:3.0:1787381475.175075:0:6587:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d520c514/0xbdc38ada7ea10093 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381475.175725:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381475.175884:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047046528 00000100:00100000:0.0:1787381475.175909:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047046528 00010000:00010000:0.0:1787381475.175951:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000da9994f5/0xbdc38ada7ea10054 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a95382a expref: 11 pid: 6590 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381475.175992:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 50 00000100:00100000:0.0:1787381475.176022:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+11:2350:x1874205047046528:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787381475.176036:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787381475.176055:0:5775:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787381475.176058:0:5775:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787381473 00002000:00010000:0.0:1787381475.176060:0:5775:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787381474 00002000:00010000:0.0:1787381475.176062:0:5775:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787381473 00010000:00010000:0.0:1787381475.176068:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000da9994f5/0xbdc38ada7ea10054 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a95382a expref: 11 pid: 6590 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.176082:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000da9994f5/0xbdc38ada7ea10054 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a95382a expref: 11 pid: 6590 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.176118:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da9994f5/0xbdc38ada7ea10054 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a95382a expref: 11 pid: 6590 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.176135:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787381475.176140:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787381475.176155:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d520c514/0xbdc38ada7ea10093 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.176165:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d520c514/0xbdc38ada7ea10093 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.176209:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787381475.176274:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+10:2350:x1874205047046528:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 273us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381475.176282:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 50 00010000:00010000:3.0:1787381475.177665:0:6587:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d520c514/0xbdc38ada7ea10093 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.177715:0:6587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d520c514/0xbdc38ada7ea10093 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.177752:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d520c514/0xbdc38ada7ea10093 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.177768:0:6587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d520c514/0xbdc38ada7ea10093 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.177777:0:6587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d520c514/0xbdc38ada7ea10093 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.177784:0:6587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb1800 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:3.0:1787381475.177795:0:6587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d520c514/0xbdc38ada7ea10093 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.177804:0:6587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d520c514/0xbdc38ada7ea10093 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.177825:0:6587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d520c514/0xbdc38ada7ea10093 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.177833:0:6587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d520c514/0xbdc38ada7ea10093 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381475.177967:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2157c09-10df-40cb-8228-ad4822122c97+9:2352:x1874205047046272:12345-192.168.203.22@tcp:1:lfs.0 Request processed in 21570us (21862us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381475.177977:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 36 00000100:00100000:2.0:1787381475.184413:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381475.184561:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047046784 00000100:00100000:0.0:1787381475.184571:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047046784 00000100:00100000:0.0:1787381475.184623:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 26 00000100:00100000:0.0:1787381475.184633:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166d3bb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+38:10481:x1874205047046784:12345-192.168.203.22@tcp:35:lfs.0 00000004:00010000:0.0:1787381475.184708:0:5794:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10085 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95383f expref: 38 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787381475.184955:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1787381475.184993:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1787381475.185754:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1787381475.185819:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea1009a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.185838:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea1003f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95381c expref: 42 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.185846:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea1009a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.185881:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea1003f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95381c expref: 42 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.185896:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea1003f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95381c expref: 42 pid: 8469 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381475.185921:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1681720380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5794:1874205065937152:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787381475.186105:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f6890c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787381475.199043:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381475.199689:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047046912 00000100:00100000:2.0:1787381475.199701:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047046912 00010000:00010000:2.0:1787381475.199741:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea1003f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95381c expref: 43 pid: 8469 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381475.199783:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 51 00000100:00100000:2.0:1787381475.199792:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f932d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2157c09-10df-40cb-8228-ad4822122c97+43:2350:x1874205047046912:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787381475.199806:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381475.199812:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea1003f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95381c expref: 43 pid: 8469 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.199825:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea1003f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95381c expref: 43 pid: 8469 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.199846:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a1643af1f00) 00010000:00010000:2.0:1787381475.199851:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea1009a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.199873:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea1009a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.199880:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea1009a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.199899:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787381475.199959:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f932d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2157c09-10df-40cb-8228-ad4822122c97+43:2350:x1874205047046912:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 168us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381475.199967:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 51 00010000:00010000:0.0:1787381475.201918:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea1003f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95381c expref: 42 pid: 8469 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381475.201943:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1681720380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5794:1874205065937152:192.168.203.22@tcp:104: 00010000:00010000:0.0:1787381475.201968:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea1009a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.201978:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea1009a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.201984:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea1009a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787381475.203751:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1787381475.204268:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1787381475.205963:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1681720380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5794:1874205065937280:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787381475.206056:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381475.206751:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f689f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787381475.207766:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065937280 00000100:00100000:2.0:1787381475.207778:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065937280 00000100:00100000:2.0:1787381475.207862:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787381475.207872:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1681722680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5794:x1874205065937280:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787381475.207994:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1681722680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5794:x1874205065937280:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 123us (1937us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381475.208001:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787381475.208225:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787381475.209052:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1681720380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5794:1874205065937280:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787381475.210398:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1787381475.210486:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1681720380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5794:1874205065937408:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787381475.210545:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381475.210588:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f6890c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787381475.210792:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065937408 00000100:00100000:2.0:1787381475.210800:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065937408 00000100:00100000:2.0:1787381475.210909:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787381475.210917:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1681720a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5794:x1874205065937408:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787381475.211946:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1681720a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5794:x1874205065937408:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 1026us (1397us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787381475.211957:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787381475.212058:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1681720380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5794:1874205065937408:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787381475.212158:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1787381475.212205:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea1009a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.212215:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea1009a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.212223:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea1009a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.212229:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c9a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787381475.212234:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea1009a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.212242:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea1009a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.212259:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a1643af1f00) 00010000:00010000:0.0:1787381475.212262:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787381475.212266:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea1009a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.212273:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea1009a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787381475.212779:0:5794:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787381475.212951:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1787381475.212960:0:5794:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 333343955103ns, next at 334343953344ns, rc = 0 00000001:00080000:0.0:1787381475.212967:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1787381475.212999:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a1643af1f00) 00010000:00010000:0.0:1787381475.213033:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787381475.213048:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10085 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95383f expref: 46 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381475.213284:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166d3bb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+45:10481:x1874205047046784:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 28652us (28877us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1787381475.213293:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 26 00000020:00080000:0.0:1787381475.213297:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00010000:00010000:2.0:1787381475.216282:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787381475.239041:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381475.239254:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047047040 00000100:00100000:3.0:1787381475.239264:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047047040 00000100:00100000:3.0:1787381475.239337:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 100 00000100:00100000:3.0:1787381475.239348:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+45:10481:x1874205047047040:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1787381475.239372:0:11324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381475.239393:0:11324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea100a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953846 expref: -99 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.239452:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea100a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953846 expref: 46 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.239468:0:11324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea100a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953846 expref: 46 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.239488:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a1643052700) 00010000:00010000:3.0:1787381475.239491:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787381475.239494:0:11324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb1200, rc 0) 00000100:00100000:3.0:1787381475.239559:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+46:10481:x1874205047047040:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 213us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381475.239566:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 100 00000100:00100000:3.0:1787381475.251763:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381475.252792:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047047296 00000100:00100000:1.0:1787381475.252805:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047047296 00000100:00100000:1.0:1787381475.252859:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 27 00000100:00100000:1.0:1787381475.252868:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+46:10481:x1874205047047296:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:1.0:1787381475.253135:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+47:10481:x1874205047047296:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 267us (1381us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1787381475.253153:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 27 00000100:00100000:0.0:1787381475.405209:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381475.405311:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047047424 00000100:00100000:1.0:1787381475.405321:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047047424 00000100:00100000:1.0:1787381475.405382:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 101 00000100:00100000:1.0:1787381475.405392:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1681721c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+47:10491:x1874205047047424:12345-192.168.203.22@tcp:34:lfs.0 00010000:00010000:1.0:1787381475.405493:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea100a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.405510:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea100a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.405522:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea100a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.405536:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea100af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.405543:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea100af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.405550:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea100af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.405654:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea100b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.405663:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea100b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.405670:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea100b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787381475.405708:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea100b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.405721:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea100a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.405728:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea100a8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.405734:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea100a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.405740:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388c00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381475.405744:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea100a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.405752:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea100a8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.405763:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a1643052a00) 00010000:00010000:1.0:1787381475.405766:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381475.405770:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea100a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.405782:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea100a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.405796:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea100af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.405802:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea100af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.405822:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea100af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.405826:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381475.405829:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea100af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.405834:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea100af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.405842:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a1659f89c00) 00010000:00010000:1.0:1787381475.405844:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381475.405847:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea100af lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.405852:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea100af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.405865:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea100b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.405871:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea100b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.405884:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea100b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.405889:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381475.405903:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea100b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.405909:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea100b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.405918:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a1643052700) 00010000:00010000:1.0:1787381475.405921:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381475.405924:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea100b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.405929:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea100b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381475.406059:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1681721c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+47:10491:x1874205047047424:12345-192.168.203.22@tcp:34:lfs.0 Request processed in 667us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381475.406067:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 101 00000100:00100000:1.0:1787381475.471566:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381475.471698:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381475.471741:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381475.473515:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047047808 00000100:00100000:3.0:1787381475.473545:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047047808 00000100:00100000:3.0:1787381475.473630:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 131 00000100:00100000:3.0:1787381475.473641:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2351:x1874205047047808:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381475.473721:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2351:x1874205047047808:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 83us (2024us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381475.473730:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 131 00000100:00080000:1.0:1787381475.473928:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787381475.475947:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047047552 00000100:00100000:2.0:1787381475.475960:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047047552 00000100:00100000:2.0:1787381475.476056:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 287 00000100:00100000:2.0:1787381475.476067:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2351:x1874205047047552:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787381475.476160:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646169850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2351:x1874205047047552:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 94us (4604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381475.476168:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 287 00000100:00100000:1.0:1787381475.481896:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381475.482396:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047048064 00000100:00100000:2.0:1787381475.482408:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047048064 00000100:00100000:2.0:1787381475.482468:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 102 00000100:00100000:2.0:1787381475.482477:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+47:10494:x1874205047048064:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1787381475.482497:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381475.482517:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea100bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a95384d expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.482584:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea100c4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.482598:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea100c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.482609:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea100c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.482622:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea100cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.482628:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea100cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.482634:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea100cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.482767:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea100d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.482774:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea100d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.482781:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea100d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787381475.482791:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787381475.482895:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea100c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.482903:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea100c4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.482909:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea100c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.482914:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681732800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381475.482918:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea100c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.482926:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea100c4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.482936:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a1643052a00) 00010000:00010000:2.0:1787381475.482939:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381475.482943:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea100c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.482960:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea100c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.482973:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea100cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.482979:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea100cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.482985:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea100cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.482990:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681732a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381475.482993:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea100cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.483000:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea100cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.483115:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a1650b8f300) 00010000:00010000:2.0:1787381475.483118:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381475.483122:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea100cb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.483128:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea100cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.483181:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea100bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95384d expref: 50 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.483207:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea100d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95384d expref: 49 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.483221:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a1643052700) 00010000:00010000:2.0:1787381475.483224:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787381475.483227:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1681733000, rc 0) 00000100:00100000:2.0:1787381475.483285:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+49:10494:x1874205047048064:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 808us (1398us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1787381475.483292:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 102 00000100:00100000:0.0:1787381475.485027:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047047680 00000100:00100000:0.0:1787381475.485041:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047047680 00000100:00100000:0.0:1787381475.485106:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 61 00000100:00100000:0.0:1787381475.485116:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+8:2351:x1874205047047680:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787381475.485209:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+8:2351:x1874205047047680:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 94us (13467us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381475.485217:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 61 00000100:00080000:2.0:1787381475.485724:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787381475.496561:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381475.496642:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047048192 00000100:00100000:0.0:1787381475.496651:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047048192 00000100:00100000:0.0:1787381475.496737:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 103 00000100:00100000:0.0:1787381475.496747:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+49:10494:x1874205047048192:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:0.0:1787381475.496809:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea100e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.496825:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea100e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.496836:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea100e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.496860:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea100e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.496878:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea100e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.496885:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea100e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.496891:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c9400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787381475.496895:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea100e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.496902:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea100e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.496913:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a1643052700) 00010000:00010000:0.0:1787381475.496916:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787381475.496919:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea100e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.496925:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea100e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381475.496993:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+49:10494:x1874205047048192:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 247us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381475.497001:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 103 00000100:00100000:0.0:1787381475.503127:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381475.503211:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047048448 00000100:00100000:1.0:1787381475.503220:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047048448 00000100:00100000:1.0:1787381475.503289:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 28 00000100:00100000:1.0:1787381475.503304:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1681721880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+49:10494:x1874205047048448:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:1.0:1787381475.503606:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1681721880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+50:10494:x1874205047048448:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 308us (488us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1787381475.503614:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 28 00000100:00100000:1.0:1787381475.587311:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381475.587463:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047048704 00000100:00100000:3.0:1787381475.587474:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047048704 00000100:00100000:3.0:1787381475.587535:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 104 00000100:00100000:3.0:1787381475.587545:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+50:10505:x1874205047048704:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:3.0:1787381475.587569:0:11324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381475.587573:0:11324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787381475.587598:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea10062 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953831 expref: 50 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.587616:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a1643052a00) 00010000:00010000:3.0:1787381475.587621:0:11324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787381475.587633:0:11324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea100e7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953854 expref: -99 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.587737:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea100ee lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.587752:0:11324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea100d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95384d expref: 50 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.587761:0:11324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea100ee lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.587825:0:11324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea100d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95384d expref: 50 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.587839:0:11324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea100d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95384d expref: 50 pid: 5790 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381475.587852:0:11324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f7100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11324:1874205065937536:192.168.203.22@tcp:104: 00000100:00100000:3.0:1787381475.587945:0:11324:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1647423540 going to sleep for 11 seconds 00000100:00100000:0.0:1787381475.594634:0:11324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f7100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11324:1874205065937536:192.168.203.22@tcp:104: 00010000:00010000:0.0:1787381475.594668:0:11324:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea100ee lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381475.596486:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381475.596969:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047048832 00000100:00100000:2.0:1787381475.596983:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047048832 00010000:00010000:2.0:1787381475.597051:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea100d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95384d expref: 51 pid: 5790 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381475.597085:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 52 00000100:00100000:2.0:1787381475.597096:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+51:2350:x1874205047048832:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787381475.597111:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381475.597118:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea100d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95384d expref: 51 pid: 5790 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.597131:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea100d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95384d expref: 51 pid: 5790 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.597166:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea100d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95384d expref: 51 pid: 5790 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.597182:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a1643052700) 00010000:00010000:2.0:1787381475.597198:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea100ee lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.597208:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea100ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.597216:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea100ee lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.597255:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787381475.597316:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+50:2350:x1874205047048832:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 221us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381475.597323:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 52 00010000:00010000:0.0:1787381475.598121:0:11324:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea100ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.598153:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea100ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787381475.598172:0:11324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787381475.598405:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea100e7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953854 expref: 51 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.598424:0:11324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea100ee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953854 expref: 50 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.598433:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a1643052700) 00010000:00010000:0.0:1787381475.598435:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787381475.598438:0:11324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb0200, rc 0) 00000100:00100000:0.0:1787381475.598482:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+50:10505:x1874205047048704:12345-192.168.203.22@tcp:101:bash.0 Request processed in 10938us (11190us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1787381475.598490:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 104 00000100:00100000:3.0:1787381475.604758:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381475.605422:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047049088 00000100:00100000:1.0:1787381475.605433:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047049088 00000100:00100000:1.0:1787381475.605544:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 105 00000100:00100000:1.0:1787381475.605556:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+50:10505:x1874205047049088:12345-192.168.203.22@tcp:36:bash.0 00010000:00010000:1.0:1787381475.605821:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea100fc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.605839:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea100fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.605850:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea100fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787381475.605899:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1787381475.605924:0:5791:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000041c78814 reply state 00000000e785d4be transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea100fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381475.605934:0:5791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787381475.606088:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+53:10505:x1874205047049088:12345-192.168.203.22@tcp:36:bash.0 Request processed in 534us (1340us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1787381475.606096:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 105 00000020:00080000:1.0:1787381475.606103:0:5791:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787381475.610719:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381475.610888:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047049216 00000100:00100000:1.0:1787381475.610898:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047049216 00000100:00100000:1.0:1787381475.610956:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 106 00000100:00100000:1.0:1787381475.610966:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f5c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+53:10505:x1874205047049216:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:1.0:1787381475.610999:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381475.611049:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10103 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a95385b expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.611136:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea1010a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.611160:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea100ee lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953854 expref: 54 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.611169:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea100fc lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.611175:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea1010a lrc: 5/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.611192:0:8469:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea100fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.611217:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea100ee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953854 expref: 54 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.611231:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea100ee lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953854 expref: 54 pid: 11324 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381475.611245:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16600e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1874205065937664:192.168.203.22@tcp:104: 00000100:00100000:1.0:1787381475.611627:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1643c47900 going to sleep for 11 seconds 00010000:00010000:3.0:1787381475.612184:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea100fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.612195:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea100fc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.612202:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea100fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.612207:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388c00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381475.612211:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea100fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.612218:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea100fc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.612234:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a1643052700) 00010000:00010000:3.0:1787381475.612237:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381475.612240:0:3295:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea1010a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.612264:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea100fc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.612270:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea100fc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381475.614444:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381475.614519:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047049344 00000100:00100000:0.0:1787381475.614530:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047049344 00010000:00010000:0.0:1787381475.614566:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea100ee lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953854 expref: 54 pid: 11324 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381475.614601:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 53 00000100:00100000:0.0:1787381475.614609:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+54:2350:x1874205047049344:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787381475.614623:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787381475.614629:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea100ee lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953854 expref: 54 pid: 11324 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.614654:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea100ee lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953854 expref: 54 pid: 11324 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.614676:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a1643052700) 00010000:00010000:0.0:1787381475.614681:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea1010a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.614690:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea1010a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.614697:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea1010a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.614714:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787381475.614770:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+54:2350:x1874205047049344:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 161us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381475.614778:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 53 00010000:00010000:1.0:1787381475.615286:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea100ee lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953854 expref: 53 pid: 11324 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381475.615789:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16600e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1874205065937664:192.168.203.22@tcp:104: 00010000:00010000:1.0:1787381475.615830:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea1010a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.615840:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea1010a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.615846:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea1010a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787381475.615894:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787381475.615898:0:8469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787381475.615918:0:8469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea1010a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.615951:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10103 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95385b expref: 53 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.615965:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea1010a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95385b expref: 52 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.615974:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a1643052700) 00010000:00010000:1.0:1787381475.615977:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787381475.615980:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541388a00, rc 0) 00000100:00100000:1.0:1787381475.616083:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f5c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+52:10505:x1874205047049216:12345-192.168.203.22@tcp:101:bash.0 Request processed in 5118us (5373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381475.616105:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 106 00000100:00100000:2.0:1787381475.620693:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381475.620780:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047049600 00000100:00100000:0.0:1787381475.620790:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047049600 00000100:00100000:0.0:1787381475.620862:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 29 00000100:00100000:0.0:1787381475.620873:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+52:10505:x1874205047049600:12345-192.168.203.22@tcp:35:bash.0 00000100:00100000:0.0:1787381475.621195:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+53:10505:x1874205047049600:12345-192.168.203.22@tcp:35:bash.0 Request processed in 322us (509us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1787381475.621204:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 29 00000100:00100000:0.0:1787381475.706931:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381475.707031:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047049728 00000100:00100000:1.0:1787381475.707040:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047049728 00000100:00100000:1.0:1787381475.707102:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 107 00000100:00100000:1.0:1787381475.707113:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f5c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+53:10511:x1874205047049728:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1787381475.708982:0:11324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381475.709027:0:11324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10111 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953862 expref: -99 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.709114:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea10118 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.709128:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea10118 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.709151:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea10118 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787381475.709489:0:11324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1787381475.709495:0:11324:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787381475.709520:0:11324:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea10118 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.709549:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10111 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953862 expref: 55 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.709570:0:11324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea10118 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953862 expref: 54 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.709598:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a1643052a00) 00010000:00010000:1.0:1787381475.709601:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787381475.709604:0:11324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541389a00, rc 0) 00000100:00100000:1.0:1787381475.709684:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f5c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+54:10511:x1874205047049728:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 2572us (2761us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381475.709693:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 107 00000100:00100000:3.0:1787381475.723696:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381475.723737:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047049856 00000100:00100000:3.0:1787381475.723748:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047049856 00000100:00100000:3.0:1787381475.723809:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 108 00000100:00100000:3.0:1787381475.723819:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+54:10511:x1874205047049856:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1787381475.723841:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381475.723860:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea1011f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953869 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.723947:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea10126 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.723964:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea10126 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.723978:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea10126 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.723992:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea1012d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.723998:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea1012d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.724043:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea1012d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.724155:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea10134 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.724164:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea10134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.724171:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea10134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787381475.724206:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787381475.724210:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787381475.724229:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea10134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.724241:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea10134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.724249:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea10126 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.724256:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea10126 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.724263:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea10126 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.724269:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb0800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381475.724273:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea10126 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.724287:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea10126 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.724313:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a1643052a00) 00010000:00010000:3.0:1787381475.724316:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381475.724321:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea10126 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.724328:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea10126 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.724350:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea1012d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.724356:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea1012d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.724362:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea1012d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.724367:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb1400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381475.724370:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea1012d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.724376:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea1012d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.724383:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a1643052d00) 00010000:00010000:3.0:1787381475.724386:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381475.724388:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea1012d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.724404:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea1012d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.724437:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea1011f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953869 expref: 56 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.724450:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea10134 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953869 expref: 55 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.724458:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a1643052700) 00010000:00010000:3.0:1787381475.724460:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787381475.724463:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb1a00, rc 0) 00000100:00100000:3.0:1787381475.724521:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+55:10511:x1874205047049856:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 703us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381475.724529:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 108 00000100:00100000:3.0:1787381475.731495:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381475.731695:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381475.732038:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047050240 00000100:00100000:2.0:1787381475.732048:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047050240 00000100:00100000:2.0:1787381475.732116:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 109 00000100:00100000:2.0:1787381475.732127:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16750b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+55:10511:x1874205047050240:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1787381475.732155:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381475.732174:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea1013b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953870 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.732276:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea10142 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.732293:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea1010a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95385b expref: 56 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.732302:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea10134 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953869 expref: 56 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.732322:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea10142 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.732369:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea10134 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953869 expref: 56 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.732384:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea10134 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953869 expref: 56 pid: 5790 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381475.732398:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16600c7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1874205065937792:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787381475.732567:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea1010a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95385b expref: 56 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.732578:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea1010a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95385b expref: 56 pid: 8469 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381475.732588:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16600c5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1874205065937920:192.168.203.22@tcp:104: 00000100:00100000:2.0:1787381475.732613:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f94aa80 going to sleep for 11 seconds 00010000:00010000:2.0:1787381475.735096:0:8469:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.22@tcp) returned -22 from blocking AST (req@00000000cb1e119d x1874205065937792) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea10134 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953869 expref: 56 pid: 5790 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.735125:0:8469:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea10134 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953869 expref: 56 pid: 5790 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.735159:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea10134 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953869 expref: 56 pid: 5790 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381475.735193:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16600c7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1874205065937792:192.168.203.22@tcp:104: 00000100:00100000:2.0:1787381475.736309:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16600c5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1874205065937920:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787381475.736470:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a1643052700) 00010000:00010000:2.0:1787381475.736478:0:8469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea10142 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.736490:0:8469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea10142 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.736498:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea10142 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381475.741485:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047049984 00000100:00100000:0.0:1787381475.741500:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047049984 00000100:00100000:0.0:1787381475.741597:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:0.0:1787381475.741607:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16750b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+56:2349:x1874205047049984:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787381475.741622:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787381475.741625:0:5777:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie bdc38ada7ea10134) 00010000:00010000:0.0:1787381475.741628:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787381475.741685:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16750b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+56:2349:x1874205047049984:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 80us (10204us total) trans 0 rc 116/116 00000100:00100000:0.0:1787381475.741693:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 7 00000001:00080000:3.0:1787381475.747043:0:7481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:3.0:1787381475.747064:0:7481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:3.0:1787381475.747074:0:7481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:3.0:1787381475.750980:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381475.751227:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047050368 00000100:00100000:2.0:1787381475.751241:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047050368 00010000:00010000:2.0:1787381475.751285:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea1010a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95385b expref: 56 pid: 8469 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381475.751330:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 54 00000100:00100000:2.0:1787381475.751340:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1665874050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2157c09-10df-40cb-8228-ad4822122c97+56:2349:x1874205047050368:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787381475.751355:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381475.751362:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea1010a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95385b expref: 56 pid: 8469 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.751376:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea1010a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95385b expref: 56 pid: 8469 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.751421:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea1010a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95385b expref: 56 pid: 8469 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.751438:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a1643052700) 00010000:00010000:2.0:1787381475.751443:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea10142 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.751453:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea10142 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.751460:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea10142 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.751549:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787381475.751607:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1665874050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2157c09-10df-40cb-8228-ad4822122c97+55:2349:x1874205047050368:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 268us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381475.751617:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 54 00010000:00010000:1.0:1787381475.752971:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea10142 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.752986:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea10142 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787381475.753105:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787381475.753477:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea1013b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953870 expref: 56 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.753500:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea10142 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953870 expref: 55 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.753510:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a1643052700) 00010000:00010000:2.0:1787381475.753513:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787381475.753516:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1681732a00, rc 0) 00000100:00100000:2.0:1787381475.753629:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16750b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+55:10511:x1874205047050240:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 21503us (21933us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1787381475.753654:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 109 00000100:00100000:3.0:1787381475.756960:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381475.757154:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047050624 00000100:00100000:0.0:1787381475.757164:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047050624 00000100:00100000:0.0:1787381475.757227:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:0.0:1787381475.757238:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16750b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+55:10511:x1874205047050624:12345-192.168.203.22@tcp:103:lfs.0 00010000:00010000:0.0:1787381475.757384:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787381475.757416:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea100a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953846 expref: 55 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.757435:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a1643052700) 00010000:00010000:0.0:1787381475.757441:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787381475.757842:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16750b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+54:10511:x1874205047050624:12345-192.168.203.22@tcp:103:lfs.0 Request processed in 602us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381475.757851:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:2.0:1787381475.760243:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381475.760372:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047050752 00000100:00100000:0.0:1787381475.760382:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047050752 00000100:00100000:0.0:1787381475.760475:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 110 00000100:00100000:0.0:1787381475.760485:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+54:10511:x1874205047050752:12345-192.168.203.22@tcp:58:lfs.0 00010000:00010000:0.0:1787381475.760581:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9200/0xbdc38ada7ea10150 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.760606:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9200/0xbdc38ada7ea10150 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381475.760619:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9200/0xbdc38ada7ea10150 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787381475.760800:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1787381475.760943:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+54:10511:x1874205047050752:12345-192.168.203.22@tcp:58:lfs.0 Request processed in 457us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381475.760952:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 110 00000100:00100000:1.0:1787381475.770723:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381475.770799:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047050880 00000100:00100000:3.0:1787381475.770874:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047050880 00000100:00100000:3.0:1787381475.770938:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 111 00000100:00100000:3.0:1787381475.770948:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+54:10511:x1874205047050880:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1787381475.770970:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381475.771036:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea10157 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953877 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.771098:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9200/0xbdc38ada7ea10150 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.771110:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea10157 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953877 expref: 55 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.771128:0:5791:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9200/0xbdc38ada7ea10150 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.771150:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea10157 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953877 expref: 55 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.771163:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a1643052700) 00010000:00010000:3.0:1787381475.771166:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787381475.771170:0:5791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea10157 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953877 expref: 55 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.771177:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb1c00, rc 0) 00000100:00100000:3.0:1787381475.771232:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+55:10511:x1874205047050880:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 285us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381475.771240:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 111 00000040:00080000:3.0:1787381475.916503:0:11528:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787381475.916529:0:11528:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787381475.916612:0:11528:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1787381475.916622:0:11528:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787381475.916815:0:11528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16750b4700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11528:1874205065938048:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787381475.916945:0:11528:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1647423540 going to sleep for 11 seconds 00000100:00100000:3.0:1787381475.923446:0:11528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16750b4700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11528:1874205065938048:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787381475.933513:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381475.936688:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047051008 00000100:00100000:0.0:1787381475.936704:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047051008 00000100:00100000:0.0:1787381475.936912:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 112 00000100:00100000:0.0:1787381475.936925:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+55:10512:x1874205047051008:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787381475.936960:0:8469:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787381475.937094:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+55:10512:x1874205047051008:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 171us (3589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381475.937102:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 112 00000100:00100000:1.0:1787381475.944785:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381475.945030:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047051136 00000100:00100000:3.0:1787381475.945043:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047051136 00000100:00100000:3.0:1787381475.945105:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 113 00000100:00100000:3.0:1787381475.945115:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+55:10512:x1874205047051136:12345-192.168.203.22@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787381475.945204:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea1015e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.945221:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea1015e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.945234:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea1015e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.945248:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea10165 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.945255:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea10165 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.945262:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea10165 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.945285:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea1016c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.945303:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea1016c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.945311:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea1016c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787381475.945368:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787381475.945372:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787381475.945384:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea1016c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.945395:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea1015e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.945402:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea1015e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.945408:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea1015e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.945414:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb1400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381475.945418:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea1015e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.945424:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea1015e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.945437:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a1643052000) 00010000:00010000:3.0:1787381475.945440:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381475.945445:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea1015e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.945450:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea1015e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.945462:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea10165 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.945477:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea10165 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.945482:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea10165 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.945487:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb0800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381475.945490:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea10165 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.945496:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea10165 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.945504:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9a1643052e00) 00010000:00010000:3.0:1787381475.945507:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381475.945509:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea10165 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.945515:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea10165 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.945530:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea1016c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.945535:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea1016c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.945540:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea1016c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.945544:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb0600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381475.945553:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea1016c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.945559:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea1016c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.945567:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a1643052700) 00010000:00010000:3.0:1787381475.945570:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381475.945572:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea1016c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.945578:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea1016c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381475.945653:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+55:10512:x1874205047051136:12345-192.168.203.22@tcp:34:lhsmtool_posix.0 Request processed in 539us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381475.945661:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 113 00000100:00100000:1.0:1787381475.950310:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381475.950448:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047051392 00000100:00100000:3.0:1787381475.950457:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047051392 00000100:00100000:3.0:1787381475.950519:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 114 00000100:00100000:3.0:1787381475.950529:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+55:10512:x1874205047051392:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787381475.950551:0:11324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381475.950571:0:11324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10173 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a95387e expref: -99 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.950670:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea1017a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.950685:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea1017a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.950916:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea1017a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787381475.950929:0:11324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1787381475.951070:0:11324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea1017a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.951078:0:11324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea1017a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.951084:0:11324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea1017a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.951089:0:11324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb1a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381475.951093:0:11324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea1017a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.951100:0:11324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea1017a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.951112:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a1643052700) 00010000:00010000:3.0:1787381475.951115:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787381475.951119:0:11324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea1017a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.951124:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea1017a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.951175:0:11324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10173 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95387e expref: 57 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.951207:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a1643052000) 00010000:00010000:3.0:1787381475.951209:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787381475.951213:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10173 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95387e expref: 57 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.951223:0:11324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb1200, rc 0) 00000100:00100000:3.0:1787381475.951285:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+56:10512:x1874205047051392:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 758us (997us total) trans 4294967397 rc 301/301 00000100:00100000:3.0:1787381475.951293:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 114 00000100:00100000:3.0:1787381475.954612:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381475.954743:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047051520 00000100:00100000:1.0:1787381475.954752:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047051520 00000100:00100000:1.0:1787381475.954811:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 115 00000100:00100000:1.0:1787381475.954821:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16750b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+56:10512:x1874205047051520:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787381475.954856:0:5792:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787381475.954949:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16750b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+56:10512:x1874205047051520:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 129us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381475.954956:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 115 00000100:00100000:1.0:1787381475.958452:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381475.958546:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047051776 00000100:00100000:2.0:1787381475.958556:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047051776 00000100:00100000:2.0:1787381475.958612:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 116 00000100:00100000:2.0:1787381475.958622:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+56:10512:x1874205047051776:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787381475.958643:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381475.958647:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787381475.958673:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea10118 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953862 expref: 56 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.958693:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a1643052a00) 00010000:00010000:2.0:1787381475.958697:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787381475.958710:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea10188 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953885 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787381475.959177:0:5790:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1787381475.959956:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea1018f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.959974:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea1018f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.959985:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea1018f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.960075:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea10188 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953885 expref: 58 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.960110:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea1018f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953885 expref: 57 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381475.960119:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a1650b8fc00) 00010000:00010000:2.0:1787381475.960122:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787381475.960125:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1681733200, rc 0) 00000100:00100000:2.0:1787381475.961442:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+57:10512:x1874205047051776:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 2814us (2990us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1787381475.961454:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 116 00000100:00100000:2.0:1787381475.977098:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381475.978948:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047052032 00000100:00100000:1.0:1787381475.978978:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047052032 00000100:00100000:1.0:1787381475.979117:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 117 00000100:00100000:1.0:1787381475.979128:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+57:10512:x1874205047052032:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787381475.979204:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381475.979232:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea1018f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953885 expref: 57 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.979250:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a1650b8fc00) 00010000:00010000:1.0:1787381475.979262:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787381475.979286:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea1019d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.979311:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea1019d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.979324:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea1019d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.979339:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea101a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x20802dfe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.979347:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea101a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x20802dfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.979354:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea101a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x20802dfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.979429:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea1019d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.979436:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea1019d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.979449:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea1019d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.979455:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541389c00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381475.979459:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea1019d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.979466:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea1019d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.979475:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a1643052a00) 00010000:00010000:1.0:1787381475.979479:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381475.979483:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea1019d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.979489:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea1019d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.979500:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea101a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x20802dfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.979506:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea101a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x20802dfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.979512:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea101a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x20802dfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.979517:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381475.979520:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea101a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x20802dfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.979537:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea101a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x20802dfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.979546:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x20802dfe (ffff9a1659f89c00) 00010000:00010000:1.0:1787381475.979549:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381475.979552:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea101a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x20802dfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.979558:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea101a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x20802dfe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381475.979660:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+56:10512:x1874205047052032:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 533us (2568us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787381475.979668:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 117 00000100:00100000:2.0:1787381475.982629:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381475.982718:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047052160 00000100:00100000:3.0:1787381475.982729:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047052160 00000100:00100000:3.0:1787381475.982790:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 118 00000100:00100000:3.0:1787381475.982801:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+56:10512:x1874205047052160:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787381475.982832:0:11324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381475.982855:0:11324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea101ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a95388c expref: -99 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.982893:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea101b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.982906:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea101b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.982918:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea101b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.983063:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea101ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95388c expref: 58 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.983081:0:11324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea101b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95388c expref: 57 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.983091:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a1643052e00) 00010000:00010000:3.0:1787381475.983094:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787381475.983097:0:11324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb1a00, rc 0) 00000100:00100000:3.0:1787381475.983159:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+57:10512:x1874205047052160:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 360us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381475.983166:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 118 00000100:00100000:2.0:1787381475.987421:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381475.988539:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047052416 00000100:00100000:3.0:1787381475.988555:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047052416 00000100:00100000:3.0:1787381475.988678:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 119 00000100:00100000:3.0:1787381475.988690:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+57:10512:x1874205047052416:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787381475.988772:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea101b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.988788:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea101b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.988809:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea101b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787381475.989088:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:3.0:1787381475.989098:0:5790:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 334120092363ns, next at 335120090220ns, rc = 0 00000004:00010000:3.0:1787381475.989220:0:5790:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007741d641 reply state 00000000243361ad transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea101b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381475.989230:0:5790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787381475.989850:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+59:10512:x1874205047052416:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 1159us (2434us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1787381475.989860:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 119 00000100:00100000:2.0:1787381475.995588:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00010000:00010000:3.0:1787381475.995737:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea101b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.995750:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea101b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.995757:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea101b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.995763:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb0600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381475.995767:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea101b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.995775:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea101b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.995790:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a1643052e00) 00010000:00010000:3.0:1787381475.995793:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787381475.995797:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea101b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381475.995811:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea101b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381475.995930:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047052544 00000100:00100000:1.0:1787381475.995940:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047052544 00000100:00100000:1.0:1787381475.996055:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 120 00000100:00100000:1.0:1787381475.996064:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+58:10512:x1874205047052544:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787381475.996086:0:11324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381475.996103:0:11324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea101c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953893 expref: -99 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.996166:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea101c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953893 expref: 59 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.996178:0:11324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea101c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953893 expref: 59 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381475.996223:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a1643052e00) 00010000:00010000:1.0:1787381475.996226:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787381475.996228:0:11324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541389a00, rc 0) 00000100:00100000:1.0:1787381475.996280:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+59:10512:x1874205047052544:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 218us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381475.996287:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 120 00000100:00100000:2.0:1787381476.000851:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381476.000940:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047052672 00000100:00100000:0.0:1787381476.000949:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047052672 00000100:00100000:0.0:1787381476.001031:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 37 00000100:00100000:0.0:1787381476.001042:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2157c09-10df-40cb-8228-ad4822122c97+8:2349:x1874205047052672:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787381476.001397:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2157c09-10df-40cb-8228-ad4822122c97+9:2349:x1874205047052672:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 Request processed in 356us (553us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787381476.001404:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 37 00000100:00100000:2.0:1787381476.004860:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381476.004937:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047052928 00000100:00100000:0.0:1787381476.004959:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047052928 00000100:00100000:0.0:1787381476.005048:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 30 00000100:00100000:0.0:1787381476.005057:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+59:10512:x1874205047052928:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787381476.005295:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+60:10512:x1874205047052928:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 238us (442us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1787381476.005313:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 30 00000100:00080000:2.0:1787381476.005897:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787381476.008100:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381476.008391:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047053184 00000100:00100000:0.0:1787381476.008401:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047053184 00000100:00100000:0.0:1787381476.008460:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 121 00000100:00100000:0.0:1787381476.008470:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+60:10512:x1874205047053184:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787381476.008579:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+60:10512:x1874205047053184:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 111us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381476.008587:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 121 00000100:00100000:3.0:1787381476.019308:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381476.019573:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047053312 00000100:00100000:2.0:1787381476.019583:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047053312 00000100:00100000:2.0:1787381476.019646:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 122 00000100:00100000:2.0:1787381476.019656:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16750b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+60:10512:x1874205047053312:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787381476.019677:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381476.019697:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea101c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a95389a expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.019769:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea101ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.019791:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea101ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.019816:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea101ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787381476.019857:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787381476.019876:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea101ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.019903:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea101c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95389a expref: 62 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.019920:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea101ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95389a expref: 61 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.019928:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a1643052e00) 00010000:00010000:2.0:1787381476.019931:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787381476.019935:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1681733200, rc 0) 00000100:00100000:2.0:1787381476.020047:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16750b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+61:10512:x1874205047053312:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 347us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381476.020056:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 122 00000100:00100000:2.0:1787381476.023673:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381476.023767:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047053440 00000100:00100000:0.0:1787381476.023776:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047053440 00000100:00100000:0.0:1787381476.023834:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 38 00000100:00100000:0.0:1787381476.023844:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+9:2350:x1874205047053440:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787381476.023863:0:6588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381476.023886:0:6588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6a046c8/0xbdc38ada7ea101d5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9538a1 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787381476.023913:0:6588:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8946e2, blocks: 0x1 00010000:00010000:0.0:1787381476.023934:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=334s v=(0 0) 00010000:00010000:0.0:1787381476.023938:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381476.023950:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a046c8/0xbdc38ada7ea101d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538a1 expref: 10 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.023988:0:6588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f6a046c8/0xbdc38ada7ea101d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538a1 expref: 10 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.024041:0:6588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16460c9c00, rc 0) 00000100:00100000:0.0:1787381476.024156:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+10:2350:x1874205047053440:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 313us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381476.024164:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 38 00000100:00100000:1.0:1787381476.032725:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381476.032822:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047053696 00000100:00100000:3.0:1787381476.032832:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047053696 00000100:00100000:3.0:1787381476.032889:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 123 00000100:00100000:3.0:1787381476.032899:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+61:10512:x1874205047053696:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787381476.033091:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+61:10512:x1874205047053696:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 193us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381476.033099:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 123 00000100:00100000:2.0:1787381476.049878:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381476.049972:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047053824 00000100:00100000:0.0:1787381476.049983:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047053824 00000100:00100000:0.0:1787381476.050076:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00100000:0.0:1787381476.050086:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2157c09-10df-40cb-8228-ad4822122c97+10:10512:x1874205047053824:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787381476.050103:0:7779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381476.050122:0:7779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e368c36/0xbdc38ada7ea101dc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9538a8 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.050164:0:7779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f6a046c8/0xbdc38ada7ea101d5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538a1 expref: 11 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.050172:0:7779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381476.050176:0:7779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381476.050180:0:7779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e368c36/0xbdc38ada7ea101dc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538a8 expref: 11 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.050212:0:7779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f6a046c8/0xbdc38ada7ea101d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9538a1 expref: 11 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.050239:0:7779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f6a046c8/0xbdc38ada7ea101d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9538a1 expref: 11 pid: 6588 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381476.050251:0:7779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1660095500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7779:1874205065938176:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787381476.050343:0:7779:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1646dc3600 going to sleep for 11 seconds 00000100:00100000:0.0:1787381476.062606:0:7779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1660095500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7779:1874205065938176:192.168.203.22@tcp:104: 00010000:00010000:0.0:1787381476.062649:0:7779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003e368c36/0xbdc38ada7ea101dc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538a8 expref: 11 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.062670:0:7779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16460c8200, rc 0) 00000100:00100000:0.0:1787381476.062738:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2157c09-10df-40cb-8228-ad4822122c97+11:10512:x1874205047053824:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 12653us (12878us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381476.062747:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00100000:1.0:1787381476.067873:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381476.068527:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047053952 00000100:00100000:0.0:1787381476.068539:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047053952 00010000:00010000:0.0:1787381476.068582:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f6a046c8/0xbdc38ada7ea101d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9538a1 expref: 11 pid: 6588 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381476.068628:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:0.0:1787381476.068637:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+11:2350:x1874205047053952:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787381476.068652:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787381476.068673:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f6a046c8/0xbdc38ada7ea101d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9538a1 expref: 11 pid: 6588 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.068708:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f6a046c8/0xbdc38ada7ea101d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9538a1 expref: 11 pid: 6588 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.068731:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6a046c8/0xbdc38ada7ea101d5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9538a1 expref: 11 pid: 6588 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.068748:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381476.068753:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381476.068761:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003e368c36/0xbdc38ada7ea101dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538a8 expref: 10 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.068770:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e368c36/0xbdc38ada7ea101dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538a8 expref: 10 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.068823:0:5777:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003e368c36/0xbdc38ada7ea101dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538a8 expref: 10 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381476.068837:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1660095500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5777:1874205065938304:192.168.203.22@tcp:105: 00000100:00100000:0.0:1787381476.068922:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1646dc3600 going to sleep for 11 seconds 00000100:00100000:0.0:1787381476.072034:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1660095500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5777:1874205065938304:192.168.203.22@tcp:105: 00010000:00010000:0.0:1787381476.072064:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787381476.072123:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+10:2350:x1874205047053952:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 3486us (4258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381476.072134:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:1.0:1787381476.076454:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381476.076540:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047054080 00000100:00100000:3.0:1787381476.076550:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047054080 00002000:00100000:3.0:1787381476.076601:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9a16600e9f80 x1874205047054080/t0(0) o4->f2157c09-10df-40cb-8228-ad4822122c97@192.168.203.22@tcp:527/0 lens 504/0 e 0 to 0 dl 1787381487 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787381476.076612:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a16600e9f80 with x1874205047054080 ext(0->12) 00002000:00010000:3.0:1787381476.076618:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a16600e9f80 00000100:00100000:3.0:1787381476.076645:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:3.0:1787381476.076654:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f2157c09-10df-40cb-8228-ad4822122c97+10:2350:x1874205047054080:12345-192.168.203.22@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787381476.077149:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f2157c09-10df-40cb-8228-ad4822122c97+12:2350:x1874205047054080:12345-192.168.203.22@tcp:4:lhsmtool_posix.0 Request processed in 495us (704us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787381476.077158:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 2 00002000:00100000:3.0:1787381476.077164:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9a16600e9f80 x1874205047054080/t4294967308(0) o4->f2157c09-10df-40cb-8228-ad4822122c97@192.168.203.22@tcp:527/0 lens 504/448 e 0 to 0 dl 1787381487 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787381476.077172:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a16600e9f80 with x1874205047054080 ext(0->12) 00002000:00010000:3.0:1787381476.077177:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a16600e9f80 00000100:00100000:1.0:1787381476.081607:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381476.081696:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047054208 00000100:00100000:3.0:1787381476.081707:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047054208 00000100:00100000:3.0:1787381476.082097:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 124 00000100:00100000:3.0:1787381476.082121:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+61:10512:x1874205047054208:12345-192.168.203.22@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1787381476.135176:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+61:10512:x1874205047054208:12345-192.168.203.22@tcp:44:lhsmtool_posix.0 Request processed in 53044us (53566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381476.135190:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 124 00000001:00080000:2.0:1787381476.137069:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:2.0:1787381476.137095:0:5813:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:2.0:1787381476.137113:0:5813:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a167f689f00 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1787381476.137118:0:5813:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9a16483c5800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a167f689cc0 00000020:00080000:2.0:1787381476.137147:0:5813:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9a16483c5d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a167f4ca400 00000020:00080000:2.0:1787381476.137193:0:5813:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:2.0:1787381476.137213:0:5813:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1787381476.137231:0:5813:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a167fbaccc0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1787381476.137234:0:5813:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9a166fa3b300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a167fbac540 00000020:00080000:2.0:1787381476.137236:0:5813:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9a166fa3b800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a1645452000 00000004:00080000:2.0:1787381476.137272:0:5813:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000100:00100000:2.0:1787381476.137426:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16600c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065938432:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787381476.137484:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381476.137514:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787381476.137519:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065938560:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787381476.137541:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381476.137572:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065938432 00000100:00100000:2.0:1787381476.137578:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065938432 00000100:00100000:2.0:1787381476.137625:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065938560 00000100:00100000:2.0:1787381476.137629:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065938560 00000100:00100000:2.0:1787381476.137646:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787381476.137653:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f932d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3310:x1874205065938432:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787381476.137678:0:6590:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1787381476.137702:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044417660/0xbdc38ada7ea101e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.137724:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002dbe3b62/0xbdc38ada7ea0ffa5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953807 expref: 11 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.137732:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787381476.137743:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787381476.137747:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044417660/0xbdc38ada7ea101e3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.137777:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002dbe3b62/0xbdc38ada7ea0ffa5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.22@tcp remote: 0xc01952459a953807 expref: 11 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.137791:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002dbe3b62/0xbdc38ada7ea0ffa5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.22@tcp remote: 0xc01952459a953807 expref: 11 pid: 6590 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787381476.137909:0:5825:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1787381476.138130:0:5825:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1787381476.139170:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00080000:3.0:1787381476.139746:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787381476.139796:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a5c9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6590:1874205065938688:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787381476.140051:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787381476.140067:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1660095500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065938816:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787381476.140122:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381476.140180:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047054336 00000100:00100000:0.0:1787381476.140186:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047054336 00000100:00100000:0.0:1787381476.140220:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065938816 00000100:00100000:0.0:1787381476.140223:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065938816 00000100:00100000:0.0:1787381476.140239:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787381476.140247:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674fd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3310:x1874205065938560:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787381476.140629:0:7779:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787381476.140634:0:7779:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787381474 00002000:00010000:0.0:1787381476.140636:0:7779:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787381476.140638:0:7779:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787381474 -> 1787381474 00002000:00010000:0.0:1787381476.140640:0:7779:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787381476.140685:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674fd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3310:x1874205065938560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 437us (3141us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787381476.140692:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787381476.140713:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 42 00000100:00100000:0.0:1787381476.140720:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16750b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2157c09-10df-40cb-8228-ad4822122c97+12:2349:x1874205047054336:12345-192.168.203.22@tcp:16:lhsmtool_posix.0 00000004:00080000:0.0:1787381476.141242:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a167a6f6680/2, rc 0, transno 4294967309 00000100:00100000:0.0:1787381476.141254:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065938560:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787381476.142440:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f94acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787381476.150287:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a5c9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6590:1874205065938688:192.168.203.22@tcp:104: 00010000:00010000:0.0:1787381476.150316:0:6590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000044417660/0xbdc38ada7ea101e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381476.161564:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381476.161604:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047054464 00000100:00100000:3.0:1787381476.161614:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047054464 00010000:00010000:3.0:1787381476.161648:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002dbe3b62/0xbdc38ada7ea0ffa5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.22@tcp remote: 0xc01952459a953807 expref: 13 pid: 6590 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381476.161681:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 56 00000100:00100000:3.0:1787381476.161689:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+13:2350:x1874205047054464:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787381476.161705:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787381476.161710:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002dbe3b62/0xbdc38ada7ea0ffa5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.22@tcp remote: 0xc01952459a953807 expref: 13 pid: 6590 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.161725:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002dbe3b62/0xbdc38ada7ea0ffa5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.22@tcp remote: 0xc01952459a953807 expref: 13 pid: 6590 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.161748:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dbe3b62/0xbdc38ada7ea0ffa5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.22@tcp remote: 0xc01952459a953807 expref: 13 pid: 6590 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.161762:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787381476.161767:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787381476.161772:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000044417660/0xbdc38ada7ea101e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.161793:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044417660/0xbdc38ada7ea101e3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.164157:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787381476.164222:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+12:2350:x1874205047054464:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 2529us (2665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381476.164232:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 56 00010000:00010000:3.0:1787381476.164269:0:6590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000044417660/0xbdc38ada7ea101e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.164281:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044417660/0xbdc38ada7ea101e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.164301:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044417660/0xbdc38ada7ea101e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.164309:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044417660/0xbdc38ada7ea101e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.166016:0:6590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787381476.166180:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787381476.171897:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044417660/0xbdc38ada7ea101e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.171917:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681733400 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:2.0:1787381476.171922:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044417660/0xbdc38ada7ea101e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.171933:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044417660/0xbdc38ada7ea101e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.171953:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044417660/0xbdc38ada7ea101e3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.171961:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044417660/0xbdc38ada7ea101e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.171998:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381476.172000:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381476.172017:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787381476.174718:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f932d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3310:x1874205065938432:12345-0@lo:6:osp-syn-0-0.0 Request processed in 37055us (37223us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787381476.174733:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787381476.174896:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787381476.174908:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1660097800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065938816:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787381476.174946:0:6590:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:3.0:1787381476.174982:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8946e1, atime: 0x6a8946e2, ctime: 0x6a8946e1, blocks: 0xb 00010000:00010000:3.0:1787381476.174990:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001db63c99/0xbdc38ada7ea101ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.175025:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=334s v=(0 0) 00010000:00010000:3.0:1787381476.175029:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787381476.175036:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001db63c99/0xbdc38ada7ea101ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.175054:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001db63c99/0xbdc38ada7ea101ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.175066:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001db63c99/0xbdc38ada7ea101ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.175074:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001db63c99/0xbdc38ada7ea101ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.175094:0:6590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787381476.175647:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1660097800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1874205065938816:12345-0@lo:6:osp-syn-1-0.0 Request processed in 741us (35522us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787381476.175655:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000004:00080000:3.0:1787381476.175726:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a16600c4e00/2, rc 0, transno 4294967310 00000100:00100000:3.0:1787381476.175733:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16600c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065938432:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787381476.175759:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1787381476.175772:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:3.0:1787381476.175792:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a1681720700, transno 4294967301 00000004:00080000:3.0:1787381476.175802:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:3.0:1787381476.175816:0:3309:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9a1660095500 x1874205065938816/t4294967304(4294967304) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787381492 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1787381476.175827:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a1660095500/2, rc 0, transno 4294967304 00000100:00100000:3.0:1787381476.175831:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1660095500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065938816:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1787381476.179096:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787381476.179108:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001db63c99/0xbdc38ada7ea101ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.179120:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb0600 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:0.0:1787381476.179125:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001db63c99/0xbdc38ada7ea101ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.179147:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001db63c99/0xbdc38ada7ea101ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.179168:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001db63c99/0xbdc38ada7ea101ea lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.179175:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001db63c99/0xbdc38ada7ea101ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.179197:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381476.179199:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381476.179201:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787381476.194154:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:3.0:1787381476.194171:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:3.0:1787381476.194461:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:1.0:1787381476.194644:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16750b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2157c09-10df-40cb-8228-ad4822122c97+6:2349:x1874205047054336:12345-192.168.203.22@tcp:16:lhsmtool_posix.0 Request processed in 53918us (55474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381476.194657:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 42 00000100:00100000:0.0:1787381476.198060:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381476.198166:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047054720 00000100:00100000:3.0:1787381476.198178:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047054720 00000100:00100000:3.0:1787381476.198402:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 125 00000100:00100000:3.0:1787381476.198414:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1660094a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+15:10512:x1874205047054720:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787381476.198475:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787381476.198503:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea101ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95389a expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.198524:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a1643052e00) 00010000:00010000:3.0:1787381476.198528:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787381476.198561:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea101f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.198575:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea101f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.198584:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea101f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787381476.198932:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002103074a reply state 000000000aac425c transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea101f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381476.198942:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787381476.199094:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1660094a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+16:10512:x1874205047054720:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 682us (1043us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1787381476.199103:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 125 00000100:00100000:2.0:1787381476.202599:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00010000:00010000:3.0:1787381476.202724:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea101f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.202737:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea101f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.202745:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea101f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.202751:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb1200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381476.202755:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea101f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381476.202758:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047054848 00000100:00100000:0.0:1787381476.202767:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047054848 00000100:00100000:0.0:1787381476.202871:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 44 00000100:00100000:0.0:1787381476.202882:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+6:2350:x1874205047054848:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 00010000:00010000:3.0:1787381476.202883:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea101f1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.202900:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a1643052e00) 00010000:00010000:3.0:1787381476.202903:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381476.202908:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea101f1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.202913:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea101f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787381476.203111:0:6588:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787381476.203114:0:6588:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1787381474 -> 1787381474 00002000:00010000:0.0:1787381476.203117:0:6588:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787381474 00002000:00010000:0.0:1787381476.203119:0:6588:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787381474 -> 1787381474 00002000:00010000:0.0:1787381476.203122:0:6588:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787381476.203229:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+7:2350:x1874205047054848:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 Request processed in 348us (636us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787381476.203237:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 44 00000100:00100000:0.0:1787381476.204958:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381476.205140:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047055104 00000100:00100000:2.0:1787381476.205150:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047055104 00000100:00100000:2.0:1787381476.205203:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 126 00000100:00100000:2.0:1787381476.205211:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1660094000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+15:10512:x1874205047055104:12345-192.168.203.22@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787381476.205278:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea101f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.205295:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea101b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95388c expref: 15 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.205305:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea101f8 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.205340:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea101b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95388c expref: 15 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.205353:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea101b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95388c expref: 15 pid: 11324 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381476.205370:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a5c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1874205065938944:192.168.203.22@tcp:104: 00000100:00100000:2.0:1787381476.205456:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f94a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787381476.209124:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381476.209234:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a5c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1874205065938944:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787381476.209281:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea101f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381476.209695:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047055232 00000100:00100000:0.0:1787381476.209714:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047055232 00010000:00010000:0.0:1787381476.209788:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea101b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95388c expref: 16 pid: 11324 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381476.209909:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 57 00000100:00100000:0.0:1787381476.209919:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+16:2349:x1874205047055232:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787381476.209933:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787381476.209939:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea101b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95388c expref: 16 pid: 11324 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.209953:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea101b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95388c expref: 16 pid: 11324 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.209975:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea101b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95388c expref: 16 pid: 11324 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.210046:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a1643052e00) 00010000:00010000:0.0:1787381476.210052:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea101f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.210062:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea101f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.210069:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea101f8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.210099:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787381476.210161:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+15:2349:x1874205047055232:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 243us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381476.210169:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 57 00010000:00010000:3.0:1787381476.210978:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea101f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.210989:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea101f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.211085:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea101f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.211093:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea101f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.211099:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea101f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.211105:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681733400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381476.211110:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea101f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.211118:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea101f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.211130:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a1643052e00) 00010000:00010000:3.0:1787381476.211275:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787381476.211282:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea101f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.211632:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea101f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381476.211739:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1660094000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+14:10512:x1874205047055104:12345-192.168.203.22@tcp:55:lhsmtool_posix.0 Request processed in 6524us (6786us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787381476.211748:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 126 00000100:00100000:3.0:1787381476.214352:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381476.214886:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047055360 00000100:00100000:0.0:1787381476.214897:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047055360 00000100:00100000:0.0:1787381476.214994:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 45 00000100:00100000:0.0:1787381476.215019:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645b71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2157c09-10df-40cb-8228-ad4822122c97+7:2350:x1874205047055360:12345-192.168.203.22@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787381476.215075:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000223b9aae/0xbdc38ada7ea101ff lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.215096:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003e368c36/0xbdc38ada7ea101dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538a8 expref: 7 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.215105:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381476.215109:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787381476.215115:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000223b9aae/0xbdc38ada7ea101ff lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.215179:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003e368c36/0xbdc38ada7ea101dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.22@tcp remote: 0xc01952459a9538a8 expref: 7 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.215194:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003e368c36/0xbdc38ada7ea101dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a9538a8 expref: 7 pid: 7779 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381476.215208:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1660095880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6590:1874205065939072:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787381476.215308:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a15437e8300 going to sleep for 11 seconds 00000100:00100000:3.0:1787381476.218257:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1660095880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6590:1874205065939072:192.168.203.22@tcp:104: 00010000:00010000:3.0:1787381476.218293:0:6590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000223b9aae/0xbdc38ada7ea101ff lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381476.220465:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381476.220560:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047055488 00000100:00100000:0.0:1787381476.220571:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047055488 00010000:00010000:0.0:1787381476.220610:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003e368c36/0xbdc38ada7ea101dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a9538a8 expref: 8 pid: 7779 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381476.220655:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 58 00000100:00100000:0.0:1787381476.220665:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645b73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+8:2350:x1874205047055488:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787381476.220681:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787381476.220705:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003e368c36/0xbdc38ada7ea101dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a9538a8 expref: 8 pid: 7779 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.220718:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003e368c36/0xbdc38ada7ea101dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a9538a8 expref: 8 pid: 7779 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.220741:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e368c36/0xbdc38ada7ea101dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a9538a8 expref: 8 pid: 7779 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.220787:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787381476.220791:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787381476.220798:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000223b9aae/0xbdc38ada7ea101ff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.220809:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000223b9aae/0xbdc38ada7ea101ff lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.220843:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787381476.220905:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645b73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+7:2350:x1874205047055488:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 241us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381476.220913:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 58 00010000:00010000:3.0:1787381476.221432:0:6590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000223b9aae/0xbdc38ada7ea101ff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.221453:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000223b9aae/0xbdc38ada7ea101ff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.221483:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000223b9aae/0xbdc38ada7ea101ff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.221492:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000223b9aae/0xbdc38ada7ea101ff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.221501:0:6590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000223b9aae/0xbdc38ada7ea101ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.221508:0:6590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c9400 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:3.0:1787381476.221520:0:6590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000223b9aae/0xbdc38ada7ea101ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.221529:0:6590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000223b9aae/0xbdc38ada7ea101ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.221541:0:6590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000223b9aae/0xbdc38ada7ea101ff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.221549:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000223b9aae/0xbdc38ada7ea101ff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381476.221614:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645b71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2157c09-10df-40cb-8228-ad4822122c97+6:2350:x1874205047055360:12345-192.168.203.22@tcp:1:lhsmtool_posix.0 Request processed in 6610us (7274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381476.221622:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 45 00000100:00100000:3.0:1787381476.228320:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381476.228434:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047055744 00000100:00100000:0.0:1787381476.228446:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047055744 00000100:00100000:0.0:1787381476.228510:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 127 00000100:00100000:0.0:1787381476.228521:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fb24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+14:10512:x1874205047055744:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787381476.228604:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10206 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.229385:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10206 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.229402:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10206 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.229632:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea1020d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.229664:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea101c0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953893 expref: 15 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.229673:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea1020d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.229710:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea101c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953893 expref: 15 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.229725:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea101c0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953893 expref: 15 pid: 11324 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381476.229740:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1660094e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1874205065939200:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787381476.230292:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a15437e80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787381476.234345:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381476.234536:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047055872 00000100:00100000:2.0:1787381476.234545:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047055872 00000100:00100000:3.0:1787381476.234560:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1660094e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1874205065939200:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787381476.234590:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea101c0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953893 expref: 16 pid: 11324 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.234593:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea1020d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381476.234635:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 59 00000100:00100000:2.0:1787381476.234644:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2157c09-10df-40cb-8228-ad4822122c97+16:2349:x1874205047055872:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787381476.234666:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381476.234674:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea101c0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953893 expref: 16 pid: 11324 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.234687:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea101c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953893 expref: 16 pid: 11324 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.234711:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea101c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953893 expref: 16 pid: 11324 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.234726:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a1643052e00) 00010000:00010000:2.0:1787381476.234730:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea1020d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.234738:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea1020d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.234745:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea1020d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.234775:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787381476.234830:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2157c09-10df-40cb-8228-ad4822122c97+15:2349:x1874205047055872:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 187us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381476.234837:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 59 00010000:00010000:2.0:1787381476.234859:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea1020d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.234866:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea1020d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787381476.235109:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1787381476.235268:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1787381476.235314:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1787381476.235405:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a5c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5791:1874205065939328:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787381476.237379:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381476.237517:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f94a9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1787381476.237561:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787381476.237601:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065939328 00000100:00100000:1.0:1787381476.237610:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065939328 00000100:00100000:1.0:1787381476.237695:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787381476.237705:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5791:x1874205065939328:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787381476.237840:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5791:x1874205065939328:12345-0@lo:1000:mdt00_001.0 Request processed in 136us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381476.237847:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787381476.237915:0:5791:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1787381476.237922:0:5791:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:0.0:1787381476.237941:0:5791:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a167a6f6680, transno 4294967309 00000100:00100000:0.0:1787381476.237969:0:5791:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9a16600c4e00 x1874205065938432/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787381492 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381476.237983:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a5c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5791:1874205065939328:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1787381476.239045:0:5791:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1787381476.239242:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1660096d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5791:1874205065939456:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787381476.239359:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381476.239731:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a15437e89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787381476.239774:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065939456 00000100:00100000:2.0:1787381476.239782:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065939456 00000100:00100000:2.0:1787381476.239830:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787381476.239839:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1660094e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5791:x1874205065939456:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787381476.240230:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1660094e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5791:x1874205065939456:12345-0@lo:1000:mdt00_001.0 Request processed in 390us (868us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787381476.240239:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787381476.240370:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1660096d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5791:1874205065939456:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1787381476.240404:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea1020d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.240427:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea1020d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.240435:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea1020d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.240441:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c8200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787381476.240574:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea1020d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.240583:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea1020d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.240598:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a1643052e00) 00010000:00010000:0.0:1787381476.240601:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787381476.240606:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea1020d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.240612:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea1020d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.240640:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9200/0xbdc38ada7ea10150 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.240647:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9200/0xbdc38ada7ea10150 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.240653:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9200/0xbdc38ada7ea10150 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.240658:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c9200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787381476.240667:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9200/0xbdc38ada7ea10150 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.240672:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9200/0xbdc38ada7ea10150 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.240681:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a1643052700) 00010000:00010000:0.0:1787381476.240683:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787381476.240690:0:5791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea10157 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953877 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.240701:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea10157 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953877 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.240710:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea10157 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953877 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.240740:0:5791:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea10157 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953877 expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381476.240753:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1660095880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1874205065939584:192.168.203.22@tcp:105: 00000100:00100000:0.0:1787381476.240920:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a15437e89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787381476.244614:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381476.244737:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1660095880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1874205065939584:192.168.203.22@tcp:105: 00000100:00100000:2.0:1787381476.244749:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047056000 00000100:00100000:2.0:1787381476.244757:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047056000 00010000:00010000:0.0:1787381476.244767:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9200/0xbdc38ada7ea10150 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.244777:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9200/0xbdc38ada7ea10150 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.244835:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea10214 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.244848:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea10214 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.244858:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea10214 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.244867:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea10214 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.244872:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea10214 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.244878:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea10214 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381476.244879:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 31 00010000:00010000:0.0:1787381476.244884:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c8a00 already unused, calling callback (ffffffffc21e64f0) 00000100:00100000:2.0:1787381476.244887:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+19:10511:x1874205047056000:12345-192.168.203.22@tcp:49:lfs.0 00010000:00010000:0.0:1787381476.244888:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea10214 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.244895:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea10214 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.244906:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a1643052700) 00010000:00010000:0.0:1787381476.244908:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787381476.244912:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea10214 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.244916:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea10214 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.244930:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10206 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.244935:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10206 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.244941:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10206 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.244945:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c8800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787381476.244948:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10206 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.244953:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10206 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.244960:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a1643052700) 00010000:00010000:0.0:1787381476.244962:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787381476.244965:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10206 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.244969:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10206 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381476.245047:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+19:10511:x1874205047056000:12345-192.168.203.22@tcp:49:lfs.0 Request processed in 159us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381476.245054:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 31 00000100:00100000:0.0:1787381476.245439:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fb24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+18:10512:x1874205047055744:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 16919us (17129us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1787381476.245448:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 127 00000020:00080000:0.0:1787381476.245451:0:5791:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787381476.245571:0:11528:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787381476.245577:0:11528:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787381476.246651:0:11528:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787381476.246672:0:11528:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787381476.249174:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381476.249369:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047056256 00000100:00100000:0.0:1787381476.249379:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047056256 00000100:00100000:0.0:1787381476.249540:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 32 00000100:00100000:0.0:1787381476.249551:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166d3ba850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+18:10512:x1874205047056256:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787381476.250232:0:5794:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787381476.250345:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1787381476.250389:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea1021b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.250405:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea1021b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.250416:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea1021b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.250424:0:5794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea1021b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.250430:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea1021b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.250436:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea1021b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381476.251385:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787381476.251528:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166d3ba850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+20:10512:x1874205047056256:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 1973us (2358us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1787381476.251538:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 32 00000020:00080000:0.0:1787381476.251544:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787381476.251649:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787381476.251656:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea1021b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.251673:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c8200 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:2.0:1787381476.251677:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea1021b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.251686:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea1021b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.251702:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9a1643af1d00) 00010000:00010000:2.0:1787381476.251706:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787381476.251711:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea1021b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.251716:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea1021b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.251736:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381476.251738:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381476.251740:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787381476.255247:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381476.255552:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047056512 00000100:00100000:3.0:1787381476.255563:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047056512 00000100:00100000:3.0:1787381476.255659:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 128 00000100:00100000:3.0:1787381476.255670:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+20:10511:x1874205047056512:12345-192.168.203.22@tcp:58:lfs.0 00000040:00080000:3.0:1787381476.255956:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1787381476.256086:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+20:10511:x1874205047056512:12345-192.168.203.22@tcp:58:lfs.0 Request processed in 417us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381476.256095:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 128 00000100:00100000:3.0:1787381476.305075:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381476.305467:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047056640 00000100:00100000:2.0:1787381476.305478:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047056640 00000100:00100000:2.0:1787381476.305539:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 129 00000100:00100000:2.0:1787381476.305548:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+20:10514:x1874205047056640:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1787381476.305572:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381476.305607:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea10222 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9538af expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.305670:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea10229 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.305684:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea10229 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.305696:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea10229 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.305710:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10230 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.305718:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10230 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.305723:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10230 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.306056:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea10237 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.306069:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea10142 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953870 expref: 21 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.306077:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea10237 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.306109:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea10142 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953870 expref: 21 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.306145:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea10142 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953870 expref: 21 pid: 8469 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381476.306160:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a5c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1874205065939712:192.168.203.22@tcp:104: 00000100:00100000:2.0:1787381476.306250:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f94a600 going to sleep for 11 seconds 00000100:00100000:1.0:1787381476.313220:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381476.313277:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a5c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1874205065939712:192.168.203.22@tcp:104: 00000100:00100000:3.0:1787381476.313345:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047056896 00000100:00100000:3.0:1787381476.313355:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047056896 00000100:00100000:3.0:1787381476.313446:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 33 00000100:00100000:3.0:1787381476.313456:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+22:5564:x1874205047056896:12345-192.168.203.22@tcp:35:ldlm_bl.0 00010000:00010000:2.0:1787381476.313580:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea10237 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381476.314000:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+23:5564:x1874205047056896:12345-192.168.203.22@tcp:35:ldlm_bl.0 Request processed in 545us (788us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1787381476.314029:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 33 00000100:00100000:1.0:1787381476.317226:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381476.317422:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047057024 00000100:00100000:2.0:1787381476.317431:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047057024 00010000:00010000:2.0:1787381476.317474:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea10142 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953870 expref: 23 pid: 8469 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381476.317520:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 60 00000100:00100000:2.0:1787381476.317530:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1665877050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+23:2349:x1874205047057024:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787381476.317545:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381476.317552:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea10142 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953870 expref: 23 pid: 8469 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.317563:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea10142 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953870 expref: 23 pid: 8469 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.317586:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea10142 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953870 expref: 23 pid: 8469 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.318442:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a1643052700) 00010000:00010000:2.0:1787381476.318454:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea10237 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.318465:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea10237 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.318474:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea10237 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381476.318517:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787381476.318583:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1665877050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+22:2349:x1874205047057024:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 1053us (1363us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381476.318592:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 60 00010000:00010000:3.0:1787381476.318768:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea10237 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.318777:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea10237 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787381476.318831:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787381476.318835:0:8469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787381476.318854:0:8469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea10237 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.318868:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea10237 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.318877:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea10229 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.318950:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea10229 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.318958:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea10229 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.318964:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681733400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381476.318969:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea10229 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.318976:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea10229 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.318987:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a1643052a00) 00010000:00010000:3.0:1787381476.318990:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381476.318994:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea10229 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.318999:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea10229 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.319037:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10230 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.319160:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10230 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.319169:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10230 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.319174:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681732800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381476.319183:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10230 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.319190:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10230 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.319200:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9a1650b8f300) 00010000:00010000:3.0:1787381476.319203:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381476.319206:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10230 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.319211:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10230 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.319249:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea10222 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538af expref: 22 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.319263:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea10237 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538af expref: 21 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381476.319270:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a1643052700) 00010000:00010000:3.0:1787381476.319273:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787381476.319275:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1681733200, rc 0) 00000100:00100000:3.0:1787381476.319366:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+21:10514:x1874205047056640:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 13818us (14303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381476.319374:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 129 00000040:00080000:2.0:1787381477.216680:0:11894:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787381477.216694:0:11894:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787381477.216771:0:11894:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787381477.216779:0:11894:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1787381477.261368:0:11528:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787381477.261395:0:11528:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787381477.261463:0:11528:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787381477.261470:0:11528:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787381477.261636:0:11528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a5c9c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11528:1874205065939840:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787381477.261768:0:11528:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f94a3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1787381477.261834:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787381477.276750:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381477.276846:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047057152 00000100:00100000:1.0:1787381477.276859:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047057152 00000100:00100000:1.0:1787381477.276936:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 130 00000100:00100000:1.0:1787381477.276959:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1660095880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+22:10525:x1874205047057152:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787381477.277028:0:5791:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787381477.277176:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1660095880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+22:10525:x1874205047057152:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 229us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381477.277185:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 130 00000100:00100000:2.0:1787381477.278027:0:11528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a5c9c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11528:1874205065939840:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787381477.286418:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381477.286833:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047057408 00000100:00100000:2.0:1787381477.286857:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047057408 00000100:00100000:2.0:1787381477.286931:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 131 00000100:00100000:2.0:1787381477.286943:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+21:10525:x1874205047057408:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787381477.286969:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381477.286996:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea1023e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9538b6 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381477.287185:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea10245 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381477.287202:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea10245 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381477.287217:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea10245 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787381477.287230:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787381477.287391:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea1023e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538b6 expref: 24 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381477.287410:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea10245 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538b6 expref: 23 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381477.287420:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a1643052700) 00010000:00010000:2.0:1787381477.287423:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787381477.287427:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1681733400, rc 0) 00000100:00100000:2.0:1787381477.287514:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+23:10525:x1874205047057408:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 573us (1106us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1787381477.287525:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 131 00000100:00100000:2.0:1787381477.293423:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381477.293499:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381477.293569:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047057792 00000100:00100000:3.0:1787381477.293583:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047057792 00000100:00100000:3.0:1787381477.293657:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 132 00000100:00100000:3.0:1787381477.293670:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+23:10525:x1874205047057792:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787381477.293792:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10253 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381477.293816:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10253 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381477.293832:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10253 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381477.293997:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047057536 00000100:00100000:0.0:1787381477.294026:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047057536 00000100:00100000:0.0:1787381477.294067:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:0.0:1787381477.294084:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+25:2352:x1874205047057536:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787381477.294097:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787381477.294119:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea10245 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538b6 expref: 25 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381477.295626:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10253 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381477.295641:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10253 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381477.295648:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10253 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381477.295655:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb1200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381477.295660:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10253 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381477.295670:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10253 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381477.295686:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a1643052700) 00010000:00010000:3.0:1787381477.295690:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787381477.295696:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10253 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381477.295701:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10253 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381477.296023:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a1643052700) 00010000:00010000:0.0:1787381477.296029:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787381477.296141:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+24:10525:x1874205047057792:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 2458us (2626us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1787381477.296154:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 132 00000040:00080000:2.0:1787381477.298659:0:11528:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787381477.298673:0:11528:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1787381477.299567:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+23:2352:x1874205047057536:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 5472us (6147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381477.299584:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 9 00000040:00080000:2.0:1787381477.299967:0:11528:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787381477.299980:0:11528:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787381477.300830:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381477.301512:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047058048 00000100:00100000:3.0:1787381477.301526:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047058048 00000100:00100000:3.0:1787381477.301588:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 34 00000100:00100000:3.0:1787381477.301599:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+23:10525:x1874205047058048:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787381477.301883:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+24:10525:x1874205047058048:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 285us (1059us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1787381477.301892:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 34 00010000:00010000:2.0:1787381478.285997:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787381478.732373:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1543326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd19486c-5291-4823-bb9c-f3a73416a496:3309:1874205065939968:0@lo:400:kworker.0 00000100:00100000:1.0:1787381478.732451:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381478.733362:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065939968 00000100:00100000:2.0:1787381478.733370:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065939968 00000100:00100000:2.0:1787381478.733414:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1787381478.733422:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164616ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+19:3309:x1874205065939968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381478.733952:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065940480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787381478.733992:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381478.734183:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1543327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065940352:0@lo:400:kworker.0 00000100:00100000:0.0:1787381478.734210:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381478.734242:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1543325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874205065940096:0@lo:400:kworker.0 00000100:00100000:0.0:1787381478.734267:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381478.734295:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1543327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1874205065940608:0@lo:400:kworker.0 00000100:00100000:0.0:1787381478.734313:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381478.734329:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787381478.734334:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1543324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1874205065940224:0@lo:400:kworker.0 00000100:00100000:0.0:1787381478.734352:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381478.734369:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1543325880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065940736:0@lo:400:kworker.0 00000100:00100000:0.0:1787381478.734390:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381478.734417:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065940096 00000100:00100000:0.0:1787381478.734421:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065940096 00000100:00100000:0.0:1787381478.734451:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065940608 00000100:00100000:0.0:1787381478.734454:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065940608 00000100:00100000:0.0:1787381478.734479:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065940224 00000100:00100000:0.0:1787381478.734491:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065940224 00000100:00100000:0.0:1787381478.734513:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787381478.734520:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1543327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874205065940096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381478.734563:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1543327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874205065940096:12345-0@lo:400:kworker.0 Request processed in 43us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381478.734571:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787381478.734588:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787381478.734595:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1543326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874205065940608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381478.734622:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1543326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874205065940608:12345-0@lo:400:kworker.0 Request processed in 28us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381478.734628:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787381478.734638:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787381478.734644:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1543325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874205065940224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381478.734667:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1543325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874205065940224:12345-0@lo:400:kworker.0 Request processed in 24us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381478.734672:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787381478.734691:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065940352 00000100:00100000:0.0:1787381478.734694:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065940352 00000100:00100000:0.0:1787381478.734717:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065940736 00000100:00100000:0.0:1787381478.734720:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065940736 00000100:00100000:0.0:1787381478.734741:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787381478.734747:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1543324a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1874205065940352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381478.734781:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1543324a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1874205065940352:12345-0@lo:400:kworker.0 Request processed in 34us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381478.735167:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787381478.735183:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787381478.735190:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1543327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1874205065940736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381478.735233:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1543327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1874205065940736:12345-0@lo:400:kworker.0 Request processed in 44us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381478.735240:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787381478.735290:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1543327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065940352:0@lo:400:kworker.0 00000100:00100000:0.0:1787381478.735324:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1543324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1874205065940224:0@lo:400:kworker.0 00000100:00100000:0.0:1787381478.735335:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1543325880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065940736:0@lo:400:kworker.0 00000100:00100000:0.0:1787381478.735344:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1543325f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874205065940096:0@lo:400:kworker.0 00000100:00100000:0.0:1787381478.735353:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1543327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1874205065940608:0@lo:400:kworker.0 00000100:00100000:2.0:1787381478.739450:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164616ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+19:3309:x1874205065939968:12345-0@lo:400:kworker.0 Request processed in 6018us (6989us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381478.739465:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1787381478.739549:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065940480 00000100:00100000:2.0:1787381478.739557:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065940480 00000100:00100000:2.0:1787381478.739604:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787381478.739613:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1874205065940480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787381478.739646:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787381478.739912:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1874205065940480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 300us (5918us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381478.739921:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1787381478.739975:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787381478.739980:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787381478.739984:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787381478.744866:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1543326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd19486c-5291-4823-bb9c-f3a73416a496:3309:1874205065939968:0@lo:400:kworker.0 00000100:00100000:0.0:1787381478.744997:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065940480:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1787381479.112260:0:11945:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787381479.112270:0:11945:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787381479.112317:0:11945:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787381479.112324:0:11945:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787381479.244336:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065940864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787381479.244408:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381479.244646:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065940864 00000100:00100000:3.0:1787381479.244654:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065940864 00000100:00100000:3.0:1787381479.244707:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787381479.244718:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1874205065940864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787381479.244755:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787381479.244818:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1874205065940864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381479.244826:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787381479.244916:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065940864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787381479.308777:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381479.308945:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047058304 00000100:00100000:2.0:1787381479.308954:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047058304 00000100:00100000:2.0:1787381479.309027:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 133 00000100:00100000:2.0:1787381479.309037:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16750b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+24:10546:x1874205047058304:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1787381479.309518:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381479.309537:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea1025a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9538bd expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381479.309626:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea10261 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381479.309639:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea10261 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381479.309649:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea10261 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787381479.309659:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787381479.309769:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea1025a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538bd expref: 27 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381479.309784:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea10261 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538bd expref: 26 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381479.309792:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a1643052700) 00010000:00010000:2.0:1787381479.309795:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787381479.309799:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1681732a00, rc 0) 00000100:00100000:2.0:1787381479.310778:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16750b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+26:10546:x1874205047058304:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 1739us (2007us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1787381479.310794:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 133 00010000:00010000:2.0:1787381479.311932:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787381479.311943:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787381479.315659:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381479.316386:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047058432 00000100:00100000:2.0:1787381479.316398:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047058432 00000100:00100000:2.0:1787381479.316459:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 134 00000100:00100000:2.0:1787381479.316468:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1543327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+26:10546:x1874205047058432:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:2.0:1787381479.316536:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea1026f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381479.316553:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea1026f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381479.316564:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea1026f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381479.316592:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea1026f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381479.316600:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea1026f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381479.316606:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea1026f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381479.316612:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681732800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381479.316617:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea1026f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381479.316624:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea1026f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381479.316645:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a1643052700) 00010000:00010000:2.0:1787381479.316648:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787381479.316653:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea1026f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381479.316659:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea1026f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381479.316743:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1543327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+26:10546:x1874205047058432:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 275us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381479.316752:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 134 00000100:00100000:2.0:1787381479.447454:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381479.447627:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047058560 00000100:00100000:0.0:1787381479.447639:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047058560 00000100:00100000:0.0:1787381479.447719:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00100000:0.0:1787381479.447731:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+6:2352:x1874205047058560:12345-192.168.203.22@tcp:101:cat.0 00010000:00010000:0.0:1787381479.447750:0:6588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381479.447772:0:6588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec873412/0xbdc38ada7ea10276 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9538c4 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787381479.447797:0:6588:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8946e2, atime: 0x6a8946e2, ctime: 0x6a8946e2, blocks: 0xb 00010000:00010000:0.0:1787381479.447816:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=337s v=(0 0) 00010000:00010000:0.0:1787381479.447833:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381479.447842:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec873412/0xbdc38ada7ea10276 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538c4 expref: 7 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381479.447861:0:6588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ec873412/0xbdc38ada7ea10276 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538c4 expref: 7 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381479.447873:0:6588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16460c9800, rc 0) 00000100:00100000:0.0:1787381479.447980:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+7:2352:x1874205047058560:12345-192.168.203.22@tcp:101:cat.0 Request processed in 252us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381479.447987:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00080000:2.0:1787381479.450930:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787381479.457180:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381479.457686:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047058688 00000100:00100000:1.0:1787381479.457696:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047058688 00002000:00100000:1.0:1787381479.457733:0:6593:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9a1674ed4380 x1874205047058688/t0(0) o3->f2157c09-10df-40cb-8228-ad4822122c97@192.168.203.22@tcp:530/0 lens 488/0 e 0 to 0 dl 1787381490 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787381479.457742:0:6593:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a1674ed4380 with x1874205047058688 ext(0->4095) 00002000:00010000:1.0:1787381479.457746:0:6593:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a1674ed4380 00000100:00100000:1.0:1787381479.457771:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 3 00000100:00100000:1.0:1787381479.457780:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f2157c09-10df-40cb-8228-ad4822122c97+7:2352:x1874205047058688:12345-192.168.203.22@tcp:3:cat.0 00000100:00100000:1.0:1787381479.458179:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f2157c09-10df-40cb-8228-ad4822122c97+7:2352:x1874205047058688:12345-192.168.203.22@tcp:3:cat.0 Request processed in 399us (1006us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787381479.458205:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 3 00002000:00100000:1.0:1787381479.458213:0:6593:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9a1674ed4380 x1874205047058688/t0(0) o3->f2157c09-10df-40cb-8228-ad4822122c97@192.168.203.22@tcp:530/0 lens 488/4536 e 0 to 0 dl 1787381490 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787381479.458222:0:6593:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a1674ed4380 with x1874205047058688 ext(0->4095) 00002000:00010000:1.0:1787381479.458226:0:6593:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a1674ed4380 00010000:00010000:2.0:1787381480.332126:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787381480.594533:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381480.594576:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381480.594614:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381480.594643:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381480.594682:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381480.594725:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047059328 00000100:00100000:3.0:1787381480.594734:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047059328 00000100:00100000:3.0:1787381480.594789:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047058944 00000100:00100000:3.0:1787381480.594793:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047058944 00000100:00100000:3.0:1787381480.594818:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 135 00000100:00100000:3.0:1787381480.594827:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2351:x1874205047059328:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381480.594898:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2351:x1874205047059328:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 72us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381480.594906:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 135 00000100:00100000:3.0:1787381480.594926:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 136 00000100:00100000:3.0:1787381480.594932:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+26:2351:x1874205047058944:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381480.594959:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+26:2351:x1874205047058944:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 27us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381480.594966:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 136 00000100:00100000:3.0:1787381480.594988:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047059072 00000100:00100000:3.0:1787381480.594991:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047059072 00000100:00100000:3.0:1787381480.595044:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047059200 00000100:00100000:3.0:1787381480.595047:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047059200 00000100:00100000:3.0:1787381480.595071:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 64 00000100:00100000:3.0:1787381480.595092:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f563100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2157c09-10df-40cb-8228-ad4822122c97+7:2351:x1874205047059072:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381480.595133:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f563100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2157c09-10df-40cb-8228-ad4822122c97+7:2351:x1874205047059072:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 54us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381480.595140:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 64 00000100:00100000:3.0:1787381480.595152:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 65 00000100:00100000:3.0:1787381480.595159:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f921880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2157c09-10df-40cb-8228-ad4822122c97+5:2351:x1874205047059200:12345-192.168.203.22@tcp:400:kworker.0 00000100:00080000:2.0:1787381480.595597:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787381480.595603:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787381480.595981:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f921880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2157c09-10df-40cb-8228-ad4822122c97+5:2351:x1874205047059200:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 819us (1295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381480.596000:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 65 00000100:00100000:0.0:1787381480.598533:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047058816 00000100:00100000:0.0:1787381480.598549:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047058816 00000100:00100000:0.0:1787381480.598619:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 289 00000100:00100000:0.0:1787381480.598629:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2351:x1874205047058816:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787381480.598693:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2351:x1874205047058816:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 65us (4169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381480.598701:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 289 00000001:00080000:1.0:1787381480.856904:0:7481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1787381481.340470:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:1.0:1787381481.340487:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:2.0:1787381481.351378:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967408 is committed 00000020:00080000:2.0:1787381481.351400:0:5813:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a15437e8180 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1787381481.351406:0:5813:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9a1660008300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a15437e83c0 00000020:00080000:2.0:1787381481.351409:0:5813:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9a1660008900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a166f918c00 00000001:00080000:2.0:1787381481.351435:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1787381481.351464:0:5813:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1787381481.351502:0:5825:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1787381481.351694:0:5825:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:2.0:1787381481.356240:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381482.381119:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381483.404161:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787381483.853975:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787381483.853996:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f920000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065940992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787381483.854076:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381483.854143:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065940992 00000100:00100000:3.0:1787381483.854151:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065940992 00000100:00100000:3.0:1787381483.854214:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787381483.854223:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a52a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065940992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787381483.854258:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787381483.854303:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a52a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065940992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381483.854310:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1787381483.854331:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787381483.855331:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16600ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874205065941248:0@lo:400:kworker.0 00000100:00100000:1.0:1787381483.855377:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381483.855410:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787381483.855418:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16600eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd19486c-5291-4823-bb9c-f3a73416a496:3311:1874205065941120:0@lo:400:kworker.0 00000100:00100000:1.0:1787381483.855446:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381483.855467:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542861500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065941632:0@lo:400:kworker.0 00000100:00100000:1.0:1787381483.855492:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381483.859036:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542862680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1874205065941504:0@lo:400:kworker.0 00000100:00100000:0.0:1787381483.859113:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381483.859155:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787381483.859163:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16600e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1874205065941376:0@lo:400:kworker.0 00000100:00100000:0.0:1787381483.859198:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381483.859232:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065941248 00000100:00100000:0.0:1787381483.859240:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065941248 00000100:00100000:0.0:1787381483.859289:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065941504 00000100:00100000:0.0:1787381483.859303:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065941504 00000100:00100000:0.0:1787381483.859330:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065941376 00000100:00100000:0.0:1787381483.859333:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065941376 00000100:00100000:0.0:1787381483.859349:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787381483.859357:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874205065941248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381483.859410:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874205065941248:12345-0@lo:400:kworker.0 Request processed in 53us (4032us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381483.859418:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787381483.859434:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787381483.859440:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1543325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874205065941504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381483.859469:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1543325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874205065941504:12345-0@lo:400:kworker.0 Request processed in 30us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381483.859476:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787381483.859486:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787381483.859492:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1543325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874205065941376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381483.859516:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1543325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874205065941376:12345-0@lo:400:kworker.0 Request processed in 24us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381483.859522:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787381483.859565:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16600ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874205065941248:0@lo:400:kworker.0 00000100:00100000:0.0:1787381483.859596:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16600e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1874205065941376:0@lo:400:kworker.0 00000100:00100000:0.0:1787381483.859605:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542862680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1874205065941504:0@lo:400:kworker.0 00000100:00080000:0.0:1787381483.859621:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787381483.864593:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1787381483.864603:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a16600c4e00, transno 4294967310 00000004:00080000:3.0:1787381483.864617:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1787381483.864649:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f920000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065940992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787381483.864747:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065941120 00000100:00100000:2.0:1787381483.864755:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065941120 00000100:00100000:2.0:1787381483.864802:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1787381483.864821:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+19:3311:x1874205065941120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381483.864906:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+19:3311:x1874205065941120:12345-0@lo:400:kworker.0 Request processed in 87us (9458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381483.864914:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1787381483.864954:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065941632 00000100:00100000:2.0:1787381483.864959:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065941632 00000100:00100000:2.0:1787381483.865001:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787381483.865028:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542862300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065941632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381483.865066:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542862300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065941632:12345-0@lo:400:kworker.0 Request processed in 40us (9574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381483.865072:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1787381483.865103:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787381483.865121:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16600eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd19486c-5291-4823-bb9c-f3a73416a496:3311:1874205065941120:0@lo:400:kworker.0 00000100:00100000:3.0:1787381483.865136:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1787381483.865140:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a1660095500, transno 4294967304 00000100:00100000:3.0:1787381483.865151:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542861500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065941632:0@lo:400:kworker.0 00000100:00100000:0.0:1787381484.364454:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a52ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065941760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787381484.364547:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381484.364827:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065941760 00000100:00100000:3.0:1787381484.364836:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065941760 00000100:00100000:3.0:1787381484.364938:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787381484.364948:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1543324700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065941760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787381484.364994:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787381484.365073:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1543324700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065941760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381484.365091:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787381484.365146:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a52ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065941760:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787381484.428187:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787381484.493522:0:11528:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787381484.493531:0:11528:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787381484.493838:0:11528:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1787381484.493845:0:11528:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787381484.552527:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381484.552630:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047059456 00000100:00100000:0.0:1787381484.552654:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047059456 00000100:00100000:0.0:1787381484.552726:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 135 00000100:00100000:0.0:1787381484.552736:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+13:10199:x1874205047059456:12345-192.168.203.22@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787381484.552845:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a529180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+13:10199:x1874205047059456:12345-192.168.203.22@tcp:60:lhsmtool_posix.0 Request processed in 110us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381484.552852:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 135 00000100:00080000:2.0:1787381484.553333:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787381484.560251:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381484.560395:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047059712 00000100:00100000:3.0:1787381484.560410:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047059712 00000100:00100000:3.0:1787381484.560486:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 35 00000100:00100000:3.0:1787381484.560497:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+13:10199:x1874205047059712:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787381484.560979:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+14:10199:x1874205047059712:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 483us (747us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1787381484.560987:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 35 00000100:00100000:1.0:1787381484.974922:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381484.975062:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047059840 00000100:00100000:0.0:1787381484.975072:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047059840 00000100:00100000:0.0:1787381484.975208:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 136 00000100:00100000:0.0:1787381484.975219:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542861f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:11000:x1874205047059840:12345-192.168.203.22@tcp:101:lsof.0 00010000:00010000:0.0:1787381484.975248:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381484.975269:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9200/0xbdc38ada7ea1027d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9538cb expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381484.975335:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea10284 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381484.975348:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea10284 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381484.975361:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea10284 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787381484.975557:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787381484.975561:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787381484.975659:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea10284 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381484.975684:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9200/0xbdc38ada7ea1027d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538cb expref: 7 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381484.975706:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea10284 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538cb expref: 6 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381484.975714:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1643af1b00) 00010000:00010000:0.0:1787381484.975717:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787381484.975721:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16460c8a00, rc 0) 00000100:00100000:0.0:1787381484.975782:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542861f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+6:11000:x1874205047059840:12345-192.168.203.22@tcp:101:lsof.0 Request processed in 565us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381484.975790:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 136 00000100:00080000:2.0:1787381484.979806:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787381485.455948:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787381485.709550:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381485.709593:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381485.709635:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381485.709670:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381485.709698:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381485.709730:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047060224 00000100:00100000:1.0:1787381485.709740:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047060224 00000100:00100000:1.0:1787381485.709802:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047060352 00000100:00100000:1.0:1787381485.709817:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047060352 00000100:00100000:1.0:1787381485.709846:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 67 00000100:00100000:1.0:1787381485.709857:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542860700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+6:2352:x1874205047060224:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787381485.710235:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542860700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+6:2352:x1874205047060224:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 378us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381485.710244:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 67 00000100:00100000:1.0:1787381485.710262:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 68 00000100:00100000:1.0:1787381485.710270:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542861880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+5:2352:x1874205047060352:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787381485.710297:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542861880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+5:2352:x1874205047060352:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 28us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381485.710304:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 68 00000100:00080000:1.0:1787381485.710324:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787381485.710328:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787381485.710555:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047060480 00000100:00100000:1.0:1787381485.710561:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047060480 00000100:00100000:1.0:1787381485.710588:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047060096 00000100:00100000:1.0:1787381485.710591:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047060096 00000100:00100000:3.0:1787381485.710608:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047059968 00000100:00100000:1.0:1787381485.710610:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 140 00000100:00100000:3.0:1787381485.710612:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047059968 00000100:00100000:1.0:1787381485.710616:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542863480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+6:2352:x1874205047060480:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381485.710636:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 291 00000100:00100000:3.0:1787381485.710643:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2352:x1874205047059968:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787381485.710648:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542863480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+6:2352:x1874205047060480:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 33us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381485.710655:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 140 00000100:00100000:1.0:1787381485.710666:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 141 00000100:00100000:1.0:1787381485.710672:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542863800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+14:2352:x1874205047060096:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381485.710682:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2352:x1874205047059968:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 40us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381485.710688:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 291 00000100:00100000:1.0:1787381485.710694:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542863800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+14:2352:x1874205047060096:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 23us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381485.710707:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 141 00010000:00010000:2.0:1787381486.478170:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787381486.516815:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1787381486.516840:0:5813:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1787381486.516907:0:5825:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1787381486.516918:0:5825:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1787381487.502617:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381488.528082:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787381488.943268:0:12149:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 02:51:26 (1787381486) 00000100:00100000:1.0:1787381488.972398:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542860a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065941888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787381488.972470:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381488.972539:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065941888 00000100:00100000:1.0:1787381488.972547:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065941888 00000100:00100000:1.0:1787381488.972599:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787381488.972608:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542863100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065941888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787381488.972644:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787381488.972690:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542863100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065941888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381488.972697:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1787381488.972717:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787381488.972750:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542860a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065941888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787381488.972959:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f920000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1874205065942400:0@lo:400:kworker.0 00000100:00100000:2.0:1787381488.972992:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381488.973045:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787381488.973075:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a52bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065942016:0@lo:400:kworker.0 00000100:00100000:2.0:1787381488.973106:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381488.973129:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1660095500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065942528:0@lo:400:kworker.0 00000100:00100000:2.0:1787381488.973156:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381488.973180:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065942016 00000100:00100000:2.0:1787381488.973185:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065942016 00000100:00100000:2.0:1787381488.973226:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1787381488.973234:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+19:3308:x1874205065942016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381488.973270:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+19:3308:x1874205065942016:12345-0@lo:400:kworker.0 Request processed in 37us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381488.973277:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1787381488.973312:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a52bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065942016:0@lo:400:kworker.0 00000100:00100000:3.0:1787381488.973455:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065942400 00000100:00100000:3.0:1787381488.973460:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065942400 00000100:00100000:3.0:1787381488.973506:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787381488.973513:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874205065942400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787381488.973560:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645b73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874205065942400:12345-0@lo:400:kworker.0 Request processed in 47us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381488.973567:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787381488.973783:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a52b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874205065942144:0@lo:400:kworker.0 00000100:00100000:1.0:1787381488.973812:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381488.973844:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787381488.973851:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a52ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1874205065942272:0@lo:400:kworker.0 00000100:00100000:1.0:1787381488.973872:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381488.973901:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065942528 00000100:00100000:1.0:1787381488.973905:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065942528 00000100:00100000:1.0:1787381488.973936:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787381488.973943:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065942528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381488.973974:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a807800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065942528:12345-0@lo:400:kworker.0 Request processed in 32us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381488.973991:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787381488.974036:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065942144 00000100:00100000:1.0:1787381488.974041:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065942144 00000100:00100000:1.0:1787381488.974073:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065942272 00000100:00100000:1.0:1787381488.974076:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065942272 00000100:00100000:1.0:1787381488.974096:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787381488.974102:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542860a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874205065942144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381488.974139:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542860a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874205065942144:12345-0@lo:400:kworker.0 Request processed in 37us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381488.974145:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787381488.974157:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787381488.974163:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542862d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874205065942272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381488.974188:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542862d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874205065942272:12345-0@lo:400:kworker.0 Request processed in 26us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381488.974194:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:2.0:1787381488.974303:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787381488.974309:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787381488.974333:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1660095500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065942528:0@lo:400:kworker.0 00000100:00100000:2.0:1787381488.974345:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f920000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1874205065942400:0@lo:400:kworker.0 00000100:00100000:1.0:1787381488.974457:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a52ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1874205065942272:0@lo:400:kworker.0 00000100:00100000:1.0:1787381488.974467:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a52b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874205065942144:0@lo:400:kworker.0 00000100:00100000:1.0:1787381489.484570:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1660096d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065942656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787381489.484649:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381489.485026:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065942656 00000100:00100000:3.0:1787381489.485034:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065942656 00000100:00100000:3.0:1787381489.485093:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787381489.485103:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542861c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065942656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787381489.485138:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787381489.485195:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542861c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065942656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381489.485319:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1660096d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065942656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787381489.485420:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:2.0:1787381489.548168:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381490.572314:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787381490.825321:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381490.825365:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381490.825403:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381490.825436:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381490.825462:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381490.825505:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047061120 00000100:00100000:1.0:1787381490.825515:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047061120 00000100:00100000:1.0:1787381490.825567:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047060736 00000100:00100000:1.0:1787381490.825571:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047060736 00000100:00100000:1.0:1787381490.825595:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 145 00000100:00100000:1.0:1787381490.825604:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542862a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+6:2351:x1874205047061120:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787381490.825678:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542862a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+6:2351:x1874205047061120:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 74us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381490.825686:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 145 00000100:00100000:1.0:1787381490.825704:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 146 00000100:00100000:1.0:1787381490.825711:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542860e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+13:2351:x1874205047060736:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381490.825811:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047060864 00000100:00100000:3.0:1787381490.825816:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047060864 00000100:00100000:3.0:1787381490.825847:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047060992 00000100:00100000:3.0:1787381490.825850:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047060992 00000100:00100000:3.0:1787381490.825869:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 70 00000100:00100000:3.0:1787381490.825875:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542863b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2157c09-10df-40cb-8228-ad4822122c97+6:2351:x1874205047060864:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381490.825917:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542863b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2157c09-10df-40cb-8228-ad4822122c97+6:2351:x1874205047060864:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 42us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381490.825923:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 70 00000100:00100000:3.0:1787381490.825936:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 71 00000100:00100000:3.0:1787381490.825943:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542861180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2157c09-10df-40cb-8228-ad4822122c97+5:2351:x1874205047060992:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381490.825969:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542861180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2157c09-10df-40cb-8228-ad4822122c97+5:2351:x1874205047060992:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 27us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381490.825975:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 71 00000100:00100000:1.0:1787381490.826564:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542860e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+13:2351:x1874205047060736:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 851us (1125us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381490.826573:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 146 00000100:00100000:2.0:1787381490.826646:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047060608 00000100:00100000:2.0:1787381490.826651:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047060608 00000100:00100000:2.0:1787381490.826690:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 293 00000100:00100000:2.0:1787381490.826698:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2351:x1874205047060608:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787381490.826737:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2351:x1874205047060608:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 40us (1427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381490.826743:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 293 00000100:00080000:2.0:1787381490.826786:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787381490.826791:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787381490.826793:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787381490.839133:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381490.843906:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047061376 00000100:00100000:3.0:1787381490.843939:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047061376 00000100:00100000:3.0:1787381490.844048:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 137 00000100:00100000:3.0:1787381490.844060:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542860380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+13:11265:x1874205047061376:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787381490.844080:0:11324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381490.844101:0:11324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea1028b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9538d2 expref: -99 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381490.844181:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea10292 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381490.844205:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea10292 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381490.844217:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea10292 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381490.844233:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea10299 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381490.844240:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea10299 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381490.844247:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea10299 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381490.844691:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea102a0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381490.844701:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea102a0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381490.844709:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea102a0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787381490.844826:0:11324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787381490.845074:0:11324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea10292 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381490.845083:0:11324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea10292 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381490.845090:0:11324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea10292 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381490.845096:0:11324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb0800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381490.845100:0:11324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea10292 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381490.845108:0:11324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea10292 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381490.845119:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a1650b8f400) 00010000:00010000:3.0:1787381490.845122:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381490.845126:0:11324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea10292 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381490.845132:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea10292 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381490.845145:0:11324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea10299 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381490.845150:0:11324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea10299 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381490.845166:0:11324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea10299 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381490.845172:0:11324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb0a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381490.845174:0:11324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea10299 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381490.845180:0:11324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea10299 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381490.845187:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a1643052d00) 00010000:00010000:3.0:1787381490.846335:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381490.846342:0:11324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea10299 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381490.846350:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea10299 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381490.846844:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea1028b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538d2 expref: 16 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381490.846860:0:11324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea102a0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538d2 expref: 15 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381490.846868:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a1643052000) 00010000:00010000:3.0:1787381490.846870:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381490.846873:0:11324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb1400, rc 0) 00000100:00100000:3.0:1787381490.846964:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542860380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+15:11265:x1874205047061376:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 2906us (7841us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1787381490.846983:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 137 00000100:00100000:3.0:1787381490.855626:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381490.855684:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381490.855768:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047061504 00000100:00100000:1.0:1787381490.855777:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047061504 00000100:00100000:1.0:1787381490.855838:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 138 00000100:00100000:1.0:1787381490.855848:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1660096d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+15:11265:x1874205047061504:12345-192.168.203.22@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787381490.855969:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1660096d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+15:11265:x1874205047061504:12345-192.168.203.22@tcp:59:lhsmtool_posix.0 Request processed in 122us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381490.855977:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 138 00000100:00100000:0.0:1787381490.857113:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047061632 00000100:00100000:0.0:1787381490.857121:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047061632 00000100:00100000:0.0:1787381490.857171:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:0.0:1787381490.857180:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1660095500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+15:2351:x1874205047061632:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787381490.857192:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787381490.857223:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea102a0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538d2 expref: 15 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381490.857248:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a1643052000) 00010000:00010000:0.0:1787381490.857254:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787381490.857295:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1660095500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+14:2351:x1874205047061632:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 116us (1610us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381490.857302:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 10 00000001:00080000:3.0:1787381491.590834:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:2.0:1787381491.596134:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787381491.660305:0:11528:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787381491.660315:0:11528:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787381491.661221:0:11528:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1787381491.661232:0:11528:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787381492.620415:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787381492.976305:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381492.976447:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047061760 00000100:00100000:0.0:1787381492.976469:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047061760 00000100:00100000:0.0:1787381492.976557:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 139 00000100:00100000:0.0:1787381492.976569:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a33dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+13:11307:x1874205047061760:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1787381492.976605:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381492.976630:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9c00/0xbdc38ada7ea102ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9538d9 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381492.976697:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea102b5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381492.976712:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea102b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381492.976725:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea102b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381492.976739:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea102bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381492.976746:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea102bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381492.976752:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea102bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381492.977084:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea102b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381492.977094:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea102b5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381492.977100:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea102b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381492.977113:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c8e00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787381492.977134:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea102b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381492.977142:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea102b5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381492.977155:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1643af1b00) 00010000:00010000:0.0:1787381492.977158:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787381492.977163:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea102b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381492.977169:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea102b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381492.977182:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea102bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381492.977187:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea102bc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381492.977192:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea102bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381492.977196:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c8400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787381492.977199:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea102bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381492.977204:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea102bc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381492.977221:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9a1643af1300) 00010000:00010000:0.0:1787381492.977224:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787381492.977227:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea102bc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381492.977232:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea102bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381492.977266:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9c00/0xbdc38ada7ea102ae lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538d9 expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381492.977284:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1643af1b00) 00010000:00010000:0.0:1787381492.977287:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787381492.977291:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9c00/0xbdc38ada7ea102ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538d9 expref: 14 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381492.977300:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16460c9c00, rc 0) 00000100:00100000:0.0:1787381492.977351:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a33dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+13:11307:x1874205047061760:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 786us (1058us total) trans 0 rc 301/301 00000100:00100000:0.0:1787381492.977359:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 139 00000100:00080000:2.0:1787381492.977623:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787381492.983895:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381492.984066:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047062016 00000100:00100000:0.0:1787381492.984077:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047062016 00000100:00100000:0.0:1787381492.984135:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 140 00000100:00100000:0.0:1787381492.984144:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+13:11307:x1874205047062016:12345-192.168.203.22@tcp:36:lfs.0 00010000:00010000:0.0:1787381492.984194:0:11324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787381492.984219:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea0fc2c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953712 expref: 13 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381492.984248:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1643af1b00) 00010000:00010000:0.0:1787381492.984253:0:11324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787381492.984494:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea102c3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381492.985160:0:11324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea10284 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538cb expref: 5 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381492.985173:0:11324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea102c3 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381492.985210:0:11324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea10284 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9538cb expref: 5 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381492.985225:0:11324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea10284 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9538cb expref: 5 pid: 5792 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381492.985240:0:11324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1543327480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11324:1874205065942784:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787381492.985336:0:11324:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a15437e80c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787381492.988769:0:11324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1543327480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11324:1874205065942784:192.168.203.22@tcp:104: 00010000:00010000:1.0:1787381492.988798:0:11324:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea102c3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381492.991676:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381492.991819:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047062144 00000100:00100000:1.0:1787381492.991830:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047062144 00010000:00010000:1.0:1787381492.992359:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea10284 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9538cb expref: 6 pid: 5792 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381492.992403:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 61 00000100:00100000:1.0:1787381492.992416:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167ab43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+6:2350:x1874205047062144:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787381492.992432:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381492.992440:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea10284 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9538cb expref: 6 pid: 5792 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381492.992454:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea10284 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9538cb expref: 6 pid: 5792 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381492.992478:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea10284 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9538cb expref: 6 pid: 5792 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381492.992496:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1643af1b00) 00010000:00010000:1.0:1787381492.992500:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea102c3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787381492.992748:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787381492.992774:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea102c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381492.992784:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea102c3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381492.994578:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381492.994655:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167ab43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2350:x1874205047062144:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 2239us (3389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381492.994666:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 61 00010000:00010000:2.0:1787381492.995204:0:11324:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea102c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381492.995216:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea102c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381492.995245:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea102ca lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381492.995259:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea102ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381492.995282:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea102ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787381493.006485:0:11324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787381493.006505:0:11324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea102c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.007394:0:11324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea102c3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.007404:0:11324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea102c3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.007411:0:11324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c9000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381493.007416:0:11324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea102c3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.007431:0:11324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea102c3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.007447:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1643af1b00) 00010000:00010000:2.0:1787381493.007450:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381493.007456:0:11324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea102c3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.007462:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea102c3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787381493.007482:0:11324:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000054c3b577 reply state 00000000041bcf22 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea102ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381493.007493:0:11324:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787381493.009066:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+14:11307:x1874205047062016:12345-192.168.203.22@tcp:36:lfs.0 Request processed in 24912us (25171us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1787381493.009080:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 140 00010000:00010000:1.0:1787381493.017266:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea102ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381493.017286:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea102ca lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381493.017293:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea102ca lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381493.017299:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681733400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381493.017304:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea102ca lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381493.017312:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea102ca lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381493.017329:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9a1650b8f600) 00010000:00010000:1.0:1787381493.017333:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381493.017337:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea102ca lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381493.017342:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea102ca lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381493.197348:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381493.197440:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047062272 00000100:00100000:2.0:1787381493.197451:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047062272 00000100:00100000:2.0:1787381493.197520:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 141 00000100:00100000:2.0:1787381493.197530:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167ab40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+13:11315:x1874205047062272:12345-192.168.203.22@tcp:101:lctl.0 00010000:00010000:2.0:1787381493.197554:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381493.197587:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea102d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9538e0 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.197655:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea102d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.197686:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea102d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.197707:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea102d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787381493.197767:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787381493.197771:0:5792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787381493.197794:0:5792:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea102d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.197820:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea102d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538e0 expref: 15 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.197839:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea102d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538e0 expref: 14 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.197846:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1650b8f100) 00010000:00010000:2.0:1787381493.197849:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787381493.197864:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1681733400, rc 0) 00000100:00100000:2.0:1787381493.197928:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167ab40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+14:11315:x1874205047062272:12345-192.168.203.22@tcp:101:lctl.0 Request processed in 400us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381493.197936:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 141 00000100:00100000:3.0:1787381493.301629:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381493.301722:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047062400 00000100:00100000:0.0:1787381493.301732:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047062400 00000100:00100000:0.0:1787381493.301795:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 142 00000100:00100000:0.0:1787381493.301807:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167ab41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+14:11321:x1874205047062400:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:0.0:1787381493.301828:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381493.301850:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9c00/0xbdc38ada7ea102df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9538e7 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.301951:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea102e6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.301982:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea102e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.301994:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea102e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.302048:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea102ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.302056:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea102ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.302063:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea102ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.302178:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea102f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.302188:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea102f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.302195:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea102f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787381493.302228:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787381493.302232:0:8469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787381493.302256:0:8469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea102f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.302279:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea102e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.302285:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea102e6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.302291:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea102e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.302297:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c8400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787381493.302300:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea102e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.302307:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea102e6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.302318:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1650b8f100) 00010000:00010000:0.0:1787381493.302321:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787381493.302325:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea102e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.302331:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea102e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.302342:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea102ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.302349:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea102ed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.302354:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea102ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.302365:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c8e00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787381493.302368:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea102ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.302375:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea102ed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.302383:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9a1643af1300) 00010000:00010000:0.0:1787381493.302386:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787381493.302389:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea102ed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.302402:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea102ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.302714:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9c00/0xbdc38ada7ea102df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538e7 expref: 16 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.302728:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea102f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538e7 expref: 15 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.302735:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a1643af1d00) 00010000:00010000:0.0:1787381493.302737:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787381493.302740:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16460c9400, rc 0) 00000100:00100000:0.0:1787381493.302801:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167ab41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+15:11321:x1874205047062400:12345-192.168.203.22@tcp:101:bash.0 Request processed in 995us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381493.302809:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 142 00000100:00100000:3.0:1787381493.305736:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381493.305952:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047062656 00000100:00100000:2.0:1787381493.305962:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047062656 00000100:00100000:2.0:1787381493.306057:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 143 00000100:00100000:2.0:1787381493.306068:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167ab43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+15:11321:x1874205047062656:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:2.0:1787381493.306088:0:11324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381493.306119:0:11324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea102fb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9538ee expref: -99 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.306263:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea10302 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.306278:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea10302 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.306290:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea10302 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.306358:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10309 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.306366:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10309 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.306374:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10309 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787381493.307716:0:11324:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1787381493.308170:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10310 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.308184:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10310 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.308194:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10310 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.308224:0:11324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea10302 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.308241:0:11324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea10302 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.308248:0:11324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea10302 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.308254:0:11324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681732000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381493.308258:0:11324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea10302 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.308265:0:11324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea10302 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.308276:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a1643af1d00) 00010000:00010000:2.0:1787381493.308279:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381493.308284:0:11324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea10302 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.308290:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea10302 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787381493.308302:0:11324:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001efc7dbb reply state 0000000012370ed4 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10309 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381493.308311:0:11324:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787381493.308342:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea102fb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538ee expref: 18 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.308356:0:11324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10310 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538ee expref: 17 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.308374:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1650b8fb00) 00010000:00010000:2.0:1787381493.308376:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787381493.308668:0:11324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16413a0e00, rc 0) 00000100:00100000:2.0:1787381493.308791:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167ab43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+18:11321:x1874205047062656:12345-192.168.203.22@tcp:101:bash.0 Request processed in 2724us (3062us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1787381493.308799:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 143 00010000:00010000:0.0:1787381493.310754:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10309 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.310782:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10309 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.310790:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10309 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.310796:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681732800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787381493.310800:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10309 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.310809:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10309 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.310835:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a1650b8fe00) 00010000:00010000:0.0:1787381493.310838:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787381493.310842:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10309 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.310848:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10309 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381493.314223:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381493.314553:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047062784 00000100:00100000:2.0:1787381493.314563:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047062784 00000100:00080000:0.0:1787381493.314624:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787381493.314642:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:2.0:1787381493.314652:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1644e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2157c09-10df-40cb-8228-ad4822122c97+5:2349:x1874205047062784:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:2.0:1787381493.314670:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381493.314690:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be540742/0xbdc38ada7ea1031e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9538f5 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787381493.314717:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787381493.314736:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=351s v=(0 0) 00010000:00010000:2.0:1787381493.314741:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787381493.314750:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be540742/0xbdc38ada7ea1031e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538f5 expref: 6 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.314769:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000be540742/0xbdc38ada7ea1031e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538f5 expref: 6 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.314781:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16413a1800, rc 0) 00000100:00100000:2.0:1787381493.314843:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1644e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2157c09-10df-40cb-8228-ad4822122c97+6:2349:x1874205047062784:12345-192.168.203.22@tcp:101:bash.0 Request processed in 193us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381493.314863:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:3.0:1787381493.320810:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381493.320968:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047062912 00000100:00100000:1.0:1787381493.320977:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047062912 00000100:00100000:2.0:1787381493.321478:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 48 00000100:00100000:2.0:1787381493.321490:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1644e1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2157c09-10df-40cb-8228-ad4822122c97+6:11321:x1874205047062912:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:2.0:1787381493.321507:0:7779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381493.321525:0:7779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000304ef184/0xbdc38ada7ea10325 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9538fc expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.321731:0:7779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000be540742/0xbdc38ada7ea1031e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538f5 expref: 7 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.321741:0:7779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787381493.321746:0:7779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787381493.321751:0:7779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000304ef184/0xbdc38ada7ea10325 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538fc expref: 7 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.321784:0:7779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000be540742/0xbdc38ada7ea1031e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9538f5 expref: 7 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.321797:0:7779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000be540742/0xbdc38ada7ea1031e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9538f5 expref: 7 pid: 6590 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381493.321811:0:7779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a804e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7779:1874205065942912:192.168.203.22@tcp:104: 00000100:00100000:2.0:1787381493.321989:0:7779:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f94acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787381493.325433:0:7779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a804e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7779:1874205065942912:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787381493.325488:0:7779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000304ef184/0xbdc38ada7ea10325 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538fc expref: 7 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.325511:0:7779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16413a1400, rc 0) 00000100:00100000:2.0:1787381493.325676:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1644e1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2157c09-10df-40cb-8228-ad4822122c97+7:11321:x1874205047062912:12345-192.168.203.22@tcp:101:bash.0 Request processed in 4187us (4873us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381493.325686:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 48 00000100:00100000:2.0:1787381493.328987:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381493.330150:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047063040 00000100:00100000:0.0:1787381493.330163:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047063040 00010000:00010000:0.0:1787381493.330546:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000be540742/0xbdc38ada7ea1031e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9538f5 expref: 7 pid: 6590 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381493.330699:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 62 00000100:00100000:0.0:1787381493.330710:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a804e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+7:2350:x1874205047063040:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787381493.330742:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787381493.330766:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000be540742/0xbdc38ada7ea1031e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9538f5 expref: 7 pid: 6590 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.330779:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000be540742/0xbdc38ada7ea1031e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9538f5 expref: 7 pid: 6590 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.330801:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be540742/0xbdc38ada7ea1031e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9538f5 expref: 7 pid: 6590 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.330828:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381493.330833:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381493.330840:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000304ef184/0xbdc38ada7ea10325 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538fc expref: 6 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.330850:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000304ef184/0xbdc38ada7ea10325 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538fc expref: 6 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.330888:0:5775:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000304ef184/0xbdc38ada7ea10325 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538fc expref: 6 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381493.330902:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1543326a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5775:1874205065943040:192.168.203.22@tcp:105: 00000100:00100000:0.0:1787381493.331099:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a15437e8240 going to sleep for 11 seconds 00000100:00100000:0.0:1787381493.335535:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1543326a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5775:1874205065943040:192.168.203.22@tcp:105: 00010000:00010000:0.0:1787381493.335563:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787381493.335710:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a804e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+6:2350:x1874205047063040:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 5000us (6731us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381493.335722:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 62 00000100:00100000:1.0:1787381493.344108:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381493.344214:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047063296 00000100:00100000:0.0:1787381493.344224:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047063296 00000100:00100000:0.0:1787381493.344282:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 36 00000100:00100000:0.0:1787381493.344293:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542861500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+17:11321:x1874205047063296:12345-192.168.203.22@tcp:35:bash.0 00000100:00100000:0.0:1787381493.344664:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542861500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+18:11321:x1874205047063296:12345-192.168.203.22@tcp:35:bash.0 Request processed in 372us (565us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1787381493.344673:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 36 00000100:00100000:3.0:1787381493.459282:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381493.459406:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047063552 00000100:00100000:0.0:1787381493.459427:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047063552 00000100:00100000:0.0:1787381493.459487:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 144 00000100:00100000:0.0:1787381493.459497:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1644e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+18:11331:x1874205047063552:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1787381493.459523:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381493.459545:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9c00/0xbdc38ada7ea1032c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953903 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787381493.459686:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787381493.459805:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9c00/0xbdc38ada7ea1032c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953903 expref: 20 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.459820:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1650b8f100) 00010000:00010000:0.0:1787381493.459823:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787381493.459828:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9c00/0xbdc38ada7ea1032c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953903 expref: 20 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.459860:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16460c9c00, rc 0) 00000100:00100000:0.0:1787381493.459933:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1644e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+19:11331:x1874205047063552:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 437us (660us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1787381493.459940:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 144 00000100:00100000:2.0:1787381493.468104:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381493.471994:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047063808 00000100:00100000:0.0:1787381493.472031:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047063808 00000100:00100000:0.0:1787381493.472106:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 37 00000100:00100000:0.0:1787381493.472116:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+19:11331:x1874205047063808:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:0.0:1787381493.472788:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+20:11331:x1874205047063808:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 671us (4692us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1787381493.472798:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 37 00000100:00100000:1.0:1787381493.594988:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381493.595269:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047063936 00000100:00100000:0.0:1787381493.595280:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047063936 00000100:00100000:0.0:1787381493.595375:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 145 00000100:00100000:0.0:1787381493.595455:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542862680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+20:11337:x1874205047063936:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1787381493.595480:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381493.595502:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9c00/0xbdc38ada7ea1033a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a95390a expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.595568:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea10341 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.595583:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea10341 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.595594:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea10341 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787381493.595669:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787381493.595673:0:8469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787381493.595808:0:8469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea10341 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.595838:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9c00/0xbdc38ada7ea1033a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95390a expref: 22 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.595857:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea10341 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95390a expref: 21 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.595865:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a1643af1d00) 00010000:00010000:0.0:1787381493.595868:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787381493.595871:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16460c8e00, rc 0) 00000100:00100000:0.0:1787381493.595974:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542862680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+21:11337:x1874205047063936:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 522us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381493.595981:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 145 00000100:00100000:1.0:1787381493.614491:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381493.614810:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047064192 00000100:00100000:2.0:1787381493.614821:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047064192 00000100:00100000:2.0:1787381493.614882:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 146 00000100:00100000:2.0:1787381493.614892:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+21:11337:x1874205047064192:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1787381493.614913:0:11324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381493.614935:0:11324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea10348 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953911 expref: -99 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.615104:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1034f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.615119:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1034f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.615130:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1034f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787381493.615142:0:11324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787381493.615281:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea10348 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953911 expref: 24 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.615309:0:11324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1034f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953911 expref: 23 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.615318:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1650b8fb00) 00010000:00010000:2.0:1787381493.615321:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787381493.615324:0:11324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16413a1600, rc 0) 00000100:00100000:2.0:1787381493.615400:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645ad8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+23:11337:x1874205047064192:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 509us (918us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1787381493.615409:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 146 00000100:00100000:2.0:1787381493.636230:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381493.636274:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381493.636538:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047064448 00000100:00100000:3.0:1787381493.636548:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047064448 00000100:00100000:3.0:1787381493.636610:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 147 00000100:00100000:3.0:1787381493.636620:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+23:11337:x1874205047064448:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1787381493.636644:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381493.636665:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea1035d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953918 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381493.636679:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047064576 00010000:00010000:3.0:1787381493.636771:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10364 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.636804:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10364 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381493.636814:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047064576 00010000:00010000:3.0:1787381493.636819:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10364 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787381493.636836:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00000100:00100000:1.0:1787381493.636919:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:1.0:1787381493.636933:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a52b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+26:2350:x1874205047064576:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787381493.636943:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381493.636961:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1034f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953911 expref: 26 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.636973:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea1035d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953918 expref: 27 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381493.636993:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1650b8fb00) 00010000:00010000:1.0:1787381493.636998:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381493.637114:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a52b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+25:2350:x1874205047064576:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 186us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381493.637121:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 11 00010000:00010000:3.0:1787381493.642782:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10364 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953918 expref: 24 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.642801:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1650b8fb00) 00010000:00010000:3.0:1787381493.642804:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787381493.642808:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb1200, rc 0) 00000100:00100000:3.0:1787381493.642893:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+24:11337:x1874205047064448:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 6274us (6671us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1787381493.642902:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 147 00010000:00010000:2.0:1787381493.644450:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787381493.666200:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381493.666268:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047064704 00000100:00100000:3.0:1787381493.666277:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047064704 00000100:00100000:3.0:1787381493.666327:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 49 00000100:00100000:3.0:1787381493.666336:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a52ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+6:2350:x1874205047064704:12345-192.168.203.22@tcp:1:lfs.0 00010000:00010000:3.0:1787381493.666394:0:6588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002dbe3b62/0xbdc38ada7ea10372 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.666412:0:6588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000304ef184/0xbdc38ada7ea10325 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538fc expref: 6 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.666431:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787381493.666436:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787381493.666441:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002dbe3b62/0xbdc38ada7ea10372 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.666474:0:6588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000304ef184/0xbdc38ada7ea10325 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.22@tcp remote: 0xc01952459a9538fc expref: 6 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.666487:0:6588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000304ef184/0xbdc38ada7ea10325 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a9538fc expref: 6 pid: 7779 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381493.666501:0:6588:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6588:1874205065943168:192.168.203.22@tcp:104: 00000100:00100000:3.0:1787381493.666596:0:6588:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a164fe860c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787381493.670276:0:6588:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6588:1874205065943168:192.168.203.22@tcp:104: 00010000:00010000:3.0:1787381493.670306:0:6588:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002dbe3b62/0xbdc38ada7ea10372 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381493.670838:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381493.671108:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047064832 00000100:00100000:3.0:1787381493.671116:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047064832 00002000:00100000:3.0:1787381493.671164:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9a167a52bb80 x1874205047064832/t0(0) o4->f2157c09-10df-40cb-8228-ad4822122c97@192.168.203.22@tcp:544/0 lens 504/0 e 0 to 0 dl 1787381504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787381493.671186:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a167a52bb80 with x1874205047064832 ext(0->12) 00010000:00010000:3.0:1787381493.671194:0:6595:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000304ef184/0xbdc38ada7ea10325 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a9538fc expref: 7 pid: 7779 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.671225:0:6595:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000304ef184/0xbdc38ada7ea10325 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a9538fc expref: 7 pid: 7779 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787381493.671233:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a167a52bb80 00000100:00100000:3.0:1787381493.671264:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:3.0:1787381493.671272:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a52bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f2157c09-10df-40cb-8228-ad4822122c97+7:2350:x1874205047064832:12345-192.168.203.22@tcp:4:lfs.0 00000100:00100000:2.0:1787381493.677132:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a52bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f2157c09-10df-40cb-8228-ad4822122c97+9:2350:x1874205047064832:12345-192.168.203.22@tcp:4:lfs.0 Request processed in 5851us (6285us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787381493.677153:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 2 00002000:00100000:2.0:1787381493.677165:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9a167a52bb80 x1874205047064832/t4294967305(0) o4->f2157c09-10df-40cb-8228-ad4822122c97@192.168.203.22@tcp:544/0 lens 504/448 e 0 to 0 dl 1787381504 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787381493.677185:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a167a52bb80 with x1874205047064832 ext(0->12) 00010000:00010000:2.0:1787381493.677195:0:6595:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000304ef184/0xbdc38ada7ea10325 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a9538fc expref: 9 pid: 7779 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.677212:0:6595:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000304ef184/0xbdc38ada7ea10325 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a9538fc expref: 9 pid: 7779 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787381493.677233:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a167a52bb80 00000100:00100000:3.0:1787381493.681783:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381493.681995:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047064960 00000100:00100000:0.0:1787381493.682036:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047064960 00010000:00010000:0.0:1787381493.682072:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000304ef184/0xbdc38ada7ea10325 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a9538fc expref: 9 pid: 7779 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381493.682117:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 63 00000100:00100000:0.0:1787381493.682127:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+9:2352:x1874205047064960:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787381493.682140:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787381493.682155:0:5775:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787381493.682170:0:5775:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787381492 00002000:00010000:0.0:1787381493.682172:0:5775:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787381492 00002000:00010000:0.0:1787381493.682174:0:5775:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787381492 00010000:00010000:0.0:1787381493.682181:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000304ef184/0xbdc38ada7ea10325 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a9538fc expref: 9 pid: 7779 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.682195:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000304ef184/0xbdc38ada7ea10325 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a9538fc expref: 9 pid: 7779 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.682216:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000304ef184/0xbdc38ada7ea10325 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a9538fc expref: 9 pid: 7779 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.682232:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787381493.682236:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787381493.682242:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002dbe3b62/0xbdc38ada7ea10372 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.682251:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002dbe3b62/0xbdc38ada7ea10372 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.682282:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787381493.682339:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+8:2352:x1874205047064960:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 214us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381493.682347:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 63 00010000:00010000:3.0:1787381493.682516:0:6588:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002dbe3b62/0xbdc38ada7ea10372 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.682526:0:6588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002dbe3b62/0xbdc38ada7ea10372 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.682549:0:6588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002dbe3b62/0xbdc38ada7ea10372 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.682557:0:6588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002dbe3b62/0xbdc38ada7ea10372 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.682576:0:6588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002dbe3b62/0xbdc38ada7ea10372 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.682583:0:6588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb0a00 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:3.0:1787381493.682587:0:6588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002dbe3b62/0xbdc38ada7ea10372 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.682604:0:6588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002dbe3b62/0xbdc38ada7ea10372 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.685552:0:6588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002dbe3b62/0xbdc38ada7ea10372 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.685572:0:6588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002dbe3b62/0xbdc38ada7ea10372 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381493.685756:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a52ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+7:2350:x1874205047064704:12345-192.168.203.22@tcp:1:lfs.0 Request processed in 19415us (19559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381493.685766:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 49 00000100:00100000:3.0:1787381493.700803:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381493.701084:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047065216 00000100:00100000:0.0:1787381493.701094:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047065216 00000100:00100000:0.0:1787381493.701154:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 38 00000100:00100000:0.0:1787381493.701166:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166d3b8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+24:11337:x1874205047065216:12345-192.168.203.22@tcp:35:lfs.0 00000004:00010000:0.0:1787381493.701237:0:5794:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10364 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953918 expref: 24 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787381493.701628:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1787381493.701671:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1787381493.703283:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1787381493.703365:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10379 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.703647:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10310 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538ee expref: 28 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.703656:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10379 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.703762:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10310 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9538ee expref: 28 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.703778:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10310 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9538ee expref: 28 pid: 11324 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381493.703794:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1543326a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5794:1874205065943296:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787381493.703890:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a15437e8000 going to sleep for 11 seconds 00000100:00100000:1.0:1787381493.710283:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381493.711272:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1543326a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5794:1874205065943296:192.168.203.22@tcp:104: 00010000:00010000:0.0:1787381493.711321:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10379 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381493.713273:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047065344 00000100:00100000:2.0:1787381493.713288:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047065344 00010000:00010000:2.0:1787381493.713334:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10310 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9538ee expref: 29 pid: 11324 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381493.713422:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 64 00000100:00100000:2.0:1787381493.713433:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1665876050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+29:2349:x1874205047065344:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787381493.713449:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381493.713456:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10310 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9538ee expref: 29 pid: 11324 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.713468:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10310 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9538ee expref: 29 pid: 11324 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.713500:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10310 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9538ee expref: 29 pid: 11324 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.713520:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1650b8fb00) 00010000:00010000:2.0:1787381493.713525:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10379 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.713534:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10379 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.713542:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10379 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.713599:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787381493.713664:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1665876050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+28:2349:x1874205047065344:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 232us (3389us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381493.713672:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 64 00010000:00010000:3.0:1787381493.714089:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10379 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.714099:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10379 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787381493.714225:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1787381493.715725:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1787381493.715871:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a52b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5794:1874205065943424:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787381493.715937:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381493.716184:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1658251840 going to sleep for 11 seconds 00000100:00100000:1.0:1787381493.716723:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065943424 00000100:00100000:1.0:1787381493.716732:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065943424 00000100:00100000:1.0:1787381493.716815:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787381493.716824:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5794:x1874205065943424:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787381493.716917:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5794:x1874205065943424:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 95us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381493.716924:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1787381493.716997:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787381493.717260:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a52b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5794:1874205065943424:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787381493.717927:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1787381493.718403:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5794:1874205065943552:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787381493.718672:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381493.718705:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1658251f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787381493.718770:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065943552 00000100:00100000:1.0:1787381493.718778:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065943552 00000100:00100000:1.0:1787381493.718869:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787381493.718880:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1660095500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5794:x1874205065943552:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787381493.719120:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1660095500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5794:x1874205065943552:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 242us (447us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787381493.719141:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787381493.719221:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5794:1874205065943552:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787381493.719278:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1787381493.719320:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10379 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.719331:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10379 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.719350:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10379 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.719356:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c8800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381493.719361:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10379 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.719369:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10379 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.719386:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1650b8fb00) 00010000:00010000:3.0:1787381493.719389:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787381493.719394:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10379 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.719401:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10379 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787381493.719619:0:5794:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787381493.719759:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1787381493.719771:0:5794:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 351850765228ns, next at 352850762862ns, rc = 0 00000001:00080000:3.0:1787381493.719777:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1787381493.719811:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1650b8fb00) 00010000:00010000:3.0:1787381493.719814:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787381493.719821:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10364 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953918 expref: 32 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381493.719928:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166d3b8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+31:11337:x1874205047065216:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 18765us (19134us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1787381493.719948:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 38 00000020:00080000:3.0:1787381493.719952:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787381493.726654:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381493.726773:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047065472 00000100:00100000:0.0:1787381493.726783:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047065472 00000100:00100000:0.0:1787381493.726846:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 148 00000100:00100000:0.0:1787381493.726857:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+31:11337:x1874205047065472:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1787381493.726880:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381493.726907:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8600/0xbdc38ada7ea10380 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a95391f expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.726965:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8600/0xbdc38ada7ea10380 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95391f expref: 32 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.726978:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8600/0xbdc38ada7ea10380 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95391f expref: 32 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.726995:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1643af1300) 00010000:00010000:0.0:1787381493.726998:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787381493.727001:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16460c8600, rc 0) 00000100:00100000:0.0:1787381493.727098:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645ad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+32:11337:x1874205047065472:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 243us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381493.727105:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 148 00000100:00100000:0.0:1787381493.730895:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381493.731068:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047065728 00000100:00100000:3.0:1787381493.731078:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047065728 00000100:00100000:3.0:1787381493.731136:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00100000:3.0:1787381493.731146:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1543326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+32:11337:x1874205047065728:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:3.0:1787381493.731659:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1543326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+33:11337:x1874205047065728:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 513us (772us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1787381493.731669:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00100000:1.0:1787381493.874324:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381493.874432:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047065984 00000100:00100000:0.0:1787381493.874442:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047065984 00000100:00100000:0.0:1787381493.874512:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 149 00000100:00100000:0.0:1787381493.874534:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645ad8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+33:11347:x1874205047065984:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1787381493.874558:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381493.874579:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea10387 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953926 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787381493.874704:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787381493.874822:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea10387 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953926 expref: 35 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.874835:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1650b8f100) 00010000:00010000:0.0:1787381493.874838:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787381493.874842:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea10387 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953926 expref: 35 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.874855:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16460c9600, rc 0) 00000100:00100000:0.0:1787381493.874921:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645ad8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+34:11347:x1874205047065984:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 389us (606us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1787381493.874928:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 149 00000100:00100000:1.0:1787381493.885768:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381493.885972:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047066112 00000100:00100000:3.0:1787381493.885983:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047066112 00000100:00100000:3.0:1787381493.886209:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 150 00000100:00100000:3.0:1787381493.886222:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645ada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+34:11347:x1874205047066112:12345-192.168.203.22@tcp:34:lfs.0 00010000:00010000:3.0:1787381493.886310:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10395 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.886340:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10395 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.886356:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10395 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.886384:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea1039c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.886393:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea1039c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.886400:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea1039c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.886524:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea103a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.886533:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea103a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.886541:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea103a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787381493.887168:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea103a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.887231:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10395 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.887240:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10395 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.887247:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10395 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.887252:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb1200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381493.887256:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10395 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.887262:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10395 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.887275:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a1643af1d00) 00010000:00010000:3.0:1787381493.887278:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381493.887282:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10395 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.887299:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10395 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.887313:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea1039c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.887491:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea1039c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.887497:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea1039c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.887501:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb0a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381493.887504:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea1039c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.887510:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea1039c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.887519:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a1643052500) 00010000:00010000:3.0:1787381493.887522:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381493.887524:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea1039c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.887529:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea1039c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.887544:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea103a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.887549:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea103a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.887636:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea103a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.887641:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb0800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381493.887643:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea103a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.887649:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea103a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.887657:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1643af1300) 00010000:00010000:3.0:1787381493.887659:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381493.887662:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea103a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381493.887667:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea103a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381493.887762:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645ada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+34:11347:x1874205047066112:12345-192.168.203.22@tcp:34:lfs.0 Request processed in 1540us (2000us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381493.887771:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 150 00000100:00100000:2.0:1787381493.892635:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381493.892732:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047066368 00000100:00100000:3.0:1787381493.892742:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047066368 00000100:00100000:3.0:1787381493.892797:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 40 00000100:00100000:3.0:1787381493.892807:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167ab43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+34:11347:x1874205047066368:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:3.0:1787381493.893449:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167ab43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+35:11347:x1874205047066368:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 641us (826us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1787381493.893459:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 40 00000100:00100000:1.0:1787381493.936455:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381493.936567:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047066624 00000100:00100000:0.0:1787381493.936578:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047066624 00000100:00100000:0.0:1787381493.936640:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 151 00000100:00100000:0.0:1787381493.936650:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645ad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+35:11350:x1874205047066624:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1787381493.936676:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381493.936698:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea103aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a95392d expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.936778:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8c00/0xbdc38ada7ea103b1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.936806:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8c00/0xbdc38ada7ea103b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.936818:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8c00/0xbdc38ada7ea103b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.936834:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8000/0xbdc38ada7ea103b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.936841:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8000/0xbdc38ada7ea103b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.936847:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8000/0xbdc38ada7ea103b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.937088:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea103bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.937097:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea103bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381493.937104:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea103bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787381493.937116:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787381493.937298:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8c00/0xbdc38ada7ea103b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381493.937307:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8c00/0xbdc38ada7ea103b1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381493.937314:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8c00/0xbdc38ada7ea103b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381493.937331:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c8c00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381493.937336:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8c00/0xbdc38ada7ea103b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381493.937343:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8c00/0xbdc38ada7ea103b1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381493.937356:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a1643af1d00) 00010000:00010000:1.0:1787381493.937359:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381493.937364:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8c00/0xbdc38ada7ea103b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381493.937370:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8c00/0xbdc38ada7ea103b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381493.937652:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8000/0xbdc38ada7ea103b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381493.937673:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8000/0xbdc38ada7ea103b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381493.937689:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8000/0xbdc38ada7ea103b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381493.937695:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c8000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381493.937699:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8000/0xbdc38ada7ea103b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381493.937705:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8000/0xbdc38ada7ea103b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381493.937715:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a1643af1f00) 00010000:00010000:1.0:1787381493.937718:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381493.937721:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8000/0xbdc38ada7ea103b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381493.937727:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8000/0xbdc38ada7ea103b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381493.937773:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea103aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95392d expref: 38 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381493.937788:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea103bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95392d expref: 37 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381493.937796:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1643af1300) 00010000:00010000:1.0:1787381493.937799:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787381493.937808:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16460c9e00, rc 0) 00000100:00100000:1.0:1787381493.937933:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645ad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+37:11350:x1874205047066624:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 1283us (1487us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1787381493.937942:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 151 00000100:00100000:1.0:1787381493.944210:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381493.944499:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047066752 00000100:00100000:2.0:1787381493.944509:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047066752 00000100:00100000:2.0:1787381493.944675:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 152 00000100:00100000:2.0:1787381493.944697:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645ad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+37:11350:x1874205047066752:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:2.0:1787381493.944773:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea103cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.944791:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea103cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.944802:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea103cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.944828:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea103cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.944855:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea103cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.944861:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea103cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.944867:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a1800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381493.944871:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea103cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.944878:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea103cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.944890:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1643af1300) 00010000:00010000:2.0:1787381493.944893:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787381493.944896:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea103cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381493.944902:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea103cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381493.944977:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645ad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+37:11350:x1874205047066752:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 284us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381493.944986:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 152 00000100:00100000:3.0:1787381493.948206:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381493.948328:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047067008 00000100:00100000:0.0:1787381493.948339:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047067008 00000100:00100000:0.0:1787381493.948414:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 41 00000100:00100000:0.0:1787381493.948425:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+37:11350:x1874205047067008:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:0.0:1787381493.948665:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+38:11350:x1874205047067008:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 241us (473us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1787381493.948697:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 41 00000100:00100000:3.0:1787381494.092967:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787381494.092991:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1645ada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065943680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787381494.093093:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381494.093227:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065943680 00000100:00100000:1.0:1787381494.093236:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065943680 00000100:00100000:1.0:1787381494.093301:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787381494.093333:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065943680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787381494.093367:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787381494.093410:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065943680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381494.093416:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1787381494.093858:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787381494.093893:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1645ada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065943680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787381494.097913:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1543324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1874205065944064:0@lo:400:kworker.0 00000100:00100000:3.0:1787381494.097993:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381494.098079:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787381494.098085:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1543326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1874205065944192:0@lo:400:kworker.0 00000100:00100000:3.0:1787381494.098107:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381494.098142:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065944064 00000100:00100000:3.0:1787381494.098149:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065944064 00000100:00100000:3.0:1787381494.098208:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065944192 00000100:00100000:3.0:1787381494.098212:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065944192 00000100:00100000:3.0:1787381494.098232:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787381494.098239:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542861500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874205065944064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787381494.098288:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542861500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874205065944064:12345-0@lo:400:kworker.0 Request processed in 49us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381494.098295:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787381494.098313:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787381494.098464:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1543325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874205065943936:0@lo:400:kworker.0 00000100:00100000:1.0:1787381494.098509:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381494.098530:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787381494.098535:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1543324e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd19486c-5291-4823-bb9c-f3a73416a496:3309:1874205065943808:0@lo:400:kworker.0 00000100:00100000:1.0:1787381494.098571:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381494.098590:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1543325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065944320:0@lo:400:kworker.0 00000100:00100000:1.0:1787381494.098611:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381494.098635:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065943936 00000100:00100000:1.0:1787381494.098638:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065943936 00000100:00100000:1.0:1787381494.098667:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787381494.098673:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874205065943936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381494.098889:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645ad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874205065943936:12345-0@lo:400:kworker.0 Request processed in 216us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381494.098896:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787381494.098947:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1543325180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874205065943936:0@lo:400:kworker.0 00000100:00100000:2.0:1787381494.099152:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065943808 00000100:00100000:2.0:1787381494.099157:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065943808 00000100:00100000:2.0:1787381494.099201:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1787381494.099208:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+19:3309:x1874205065943808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381494.099243:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+19:3309:x1874205065943808:12345-0@lo:400:kworker.0 Request processed in 36us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381494.099255:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1787381494.099304:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1543324380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1874205065944064:0@lo:400:kworker.0 00000100:00100000:3.0:1787381494.099458:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a52b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874205065944192:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787381494.099556:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787381494.099640:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065944320 00000100:00100000:0.0:1787381494.099644:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065944320 00000100:00100000:0.0:1787381494.099670:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787381494.099676:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645ad8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1874205065944320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381494.099722:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645ad8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1874205065944320:12345-0@lo:400:kworker.0 Request processed in 46us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381494.099728:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787381494.099763:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1543324e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd19486c-5291-4823-bb9c-f3a73416a496:3309:1874205065943808:0@lo:400:kworker.0 00000100:00100000:0.0:1787381494.099774:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1543325500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065944320:0@lo:400:kworker.0 00000100:00100000:3.0:1787381494.099909:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a52b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874205065944192:12345-0@lo:400:kworker.0 Request processed in 1589us (1799us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381494.099916:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787381494.100155:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1543326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1874205065944192:0@lo:400:kworker.0 00000100:00100000:3.0:1787381494.380366:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381494.380577:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047067264 00000100:00100000:1.0:1787381494.380589:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047067264 00000100:00100000:1.0:1787381494.380685:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 153 00000100:00100000:1.0:1787381494.380697:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1681721880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+38:11381:x1874205047067264:12345-192.168.203.22@tcp:101:cat.0 00010000:00010000:1.0:1787381494.380720:0:11324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381494.380742:0:11324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea103d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953934 expref: -99 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381494.380842:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea103db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381494.380856:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea103db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381494.380868:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea103db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787381494.380879:0:11324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787381494.381000:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea103d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953934 expref: 41 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381494.381056:0:11324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea103db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953934 expref: 40 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381494.381065:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1643af1300) 00010000:00010000:1.0:1787381494.381069:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787381494.381073:0:11324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541389000, rc 0) 00000100:00100000:1.0:1787381494.381155:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1681721880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+40:11381:x1874205047067264:12345-192.168.203.22@tcp:101:cat.0 Request processed in 461us (798us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1787381494.381163:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 153 00000100:00080000:3.0:1787381494.381978:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787381494.390789:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381494.390837:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381494.390953:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047067392 00000100:00100000:2.0:1787381494.390963:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047067392 00000100:00100000:2.0:1787381494.391075:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:2.0:1787381494.391084:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1543326680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2157c09-10df-40cb-8228-ad4822122c97+40:2349:x1874205047067392:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787381494.391098:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381494.391124:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea103db lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953934 expref: 40 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381494.391144:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1643af1300) 00010000:00010000:2.0:1787381494.391149:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787381494.391455:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1543326680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2157c09-10df-40cb-8228-ad4822122c97+39:2349:x1874205047067392:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 371us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381494.391464:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:3.0:1787381494.393634:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047067648 00000100:00100000:3.0:1787381494.393648:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047067648 00000100:00100000:3.0:1787381494.393782:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 42 00000100:00100000:3.0:1787381494.393793:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1543325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+39:11381:x1874205047067648:12345-192.168.203.22@tcp:35:cat.0 00000100:00100000:3.0:1787381494.395607:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1543325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+40:11381:x1874205047067648:12345-192.168.203.22@tcp:35:cat.0 Request processed in 1808us (4761us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1787381494.395620:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 42 00000100:00100000:1.0:1787381494.516777:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381494.516907:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047067904 00000100:00100000:2.0:1787381494.516917:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047067904 00000100:00100000:2.0:1787381494.516974:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 154 00000100:00100000:2.0:1787381494.516983:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645adb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+40:11387:x1874205047067904:12345-192.168.203.22@tcp:101:dd.0 00010000:00010000:2.0:1787381494.517032:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381494.517035:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787381494.517059:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea10341 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95390a expref: 40 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381494.517076:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a1643af1d00) 00010000:00010000:2.0:1787381494.517093:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787381494.517106:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea103e9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a95393b expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381494.517215:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea103f0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381494.517228:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea103bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95392d expref: 40 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381494.517235:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea103f0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381494.517265:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea103bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95392d expref: 40 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381494.517277:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea103bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95392d expref: 40 pid: 8469 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381494.517289:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a804380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1874205065944448:192.168.203.22@tcp:104: 00000100:00100000:2.0:1787381494.517377:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1658251e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787381494.521574:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a804380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1874205065944448:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787381494.521601:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea103f0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381494.524613:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381494.526379:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047068032 00000100:00100000:2.0:1787381494.526391:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047068032 00010000:00010000:2.0:1787381494.526435:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea103bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95392d expref: 41 pid: 8469 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381494.526498:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 65 00000100:00100000:2.0:1787381494.526516:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645adb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+41:2350:x1874205047068032:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787381494.526530:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381494.526536:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea103bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95392d expref: 41 pid: 8469 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381494.526548:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea103bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95392d expref: 41 pid: 8469 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381494.526568:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea103bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95392d expref: 41 pid: 8469 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381494.526585:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1643af1300) 00010000:00010000:2.0:1787381494.526590:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea103f0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381494.526599:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea103f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381494.526607:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea103f0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381494.526640:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787381494.526706:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645adb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+40:2350:x1874205047068032:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 192us (2101us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381494.526713:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 65 00010000:00010000:3.0:1787381494.526894:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea103f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381494.526904:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea103f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787381494.526923:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787381494.527102:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea103e9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95393b expref: 41 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381494.527117:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea103f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95393b expref: 40 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381494.527124:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1643af1300) 00010000:00010000:3.0:1787381494.527127:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787381494.527130:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16413a0e00, rc 0) 00000100:00100000:3.0:1787381494.527155:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645adb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+40:11387:x1874205047067904:12345-192.168.203.22@tcp:101:dd.0 Request processed in 10174us (10387us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1787381494.527161:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 154 00000100:00100000:0.0:1787381494.530411:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381494.530690:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047068288 00000100:00100000:3.0:1787381494.530699:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047068288 00000100:00100000:3.0:1787381494.530766:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 155 00000100:00100000:3.0:1787381494.530775:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1543324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+40:11387:x1874205047068288:12345-192.168.203.22@tcp:36:dd.0 00010000:00010000:3.0:1787381494.531052:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea103fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381494.531068:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea103fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381494.531079:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea103fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787381494.531125:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1787381494.531146:0:5790:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003e6f82d1 reply state 00000000b3f9dd32 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea103fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381494.531156:0:5790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787381494.531539:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1543324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+43:11387:x1874205047068288:12345-192.168.203.22@tcp:36:dd.0 Request processed in 764us (1135us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1787381494.531547:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 155 00000020:00080000:3.0:1787381494.531558:0:5790:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787381494.547309:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea103fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381494.547326:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea103fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381494.547334:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea103fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381494.547340:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb0800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381494.547344:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea103fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381494.547350:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea103fe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381494.547367:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1643af1300) 00010000:00010000:1.0:1787381494.547370:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381494.547375:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea103fe lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381494.547380:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea103fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381494.604433:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1681720700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065944576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787381494.604572:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381494.604843:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065944576 00000100:00100000:3.0:1787381494.604860:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065944576 00000100:00100000:3.0:1787381494.605190:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787381494.605202:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1543324000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1874205065944576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787381494.605225:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787381494.605277:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1543324000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1874205065944576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381494.605284:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787381494.605648:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1681720700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065944576:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787381494.672106:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787381494.733762:0:11528:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787381494.733772:0:11528:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787381494.734237:0:11528:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1787381494.734247:0:11528:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787381494.909504:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381494.910370:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047068416 00000100:00100000:2.0:1787381494.910393:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047068416 00000100:00100000:2.0:1787381494.910451:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 156 00000100:00100000:2.0:1787381494.910460:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1543324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+42:11400:x1874205047068416:12345-192.168.203.22@tcp:101:stat.0 00010000:00010000:2.0:1787381494.910483:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381494.910502:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1400/0xbdc38ada7ea10405 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953942 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381494.910579:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1040c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381494.910593:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1040c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381494.910605:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1040c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381494.910619:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea10413 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381494.910626:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea10413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381494.910631:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea10413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381494.910725:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea1041a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381494.910736:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea103f0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95393b expref: 43 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381494.910744:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea1041a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381494.910784:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea103f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95393b expref: 43 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381494.910797:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea103f0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95393b expref: 43 pid: 5792 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381494.910810:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a804380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1874205065944704:192.168.203.22@tcp:104: 00000100:00100000:2.0:1787381494.910917:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1658251e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787381494.917826:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a804380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1874205065944704:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787381494.918337:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00010000:00010000:2.0:1787381494.922250:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea1041a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381494.924601:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047068672 00000100:00100000:3.0:1787381494.924632:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047068672 00000100:00100000:3.0:1787381494.924768:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 43 00000100:00100000:3.0:1787381494.924778:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1543325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+44:5564:x1874205047068672:12345-192.168.203.22@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787381494.928331:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1543325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+45:5564:x1874205047068672:12345-192.168.203.22@tcp:35:ldlm_bl.0 Request processed in 2747us (9188us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1787381494.928346:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 43 00000100:00100000:1.0:1787381494.937417:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381494.938357:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047068800 00000100:00100000:2.0:1787381494.938379:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047068800 00010000:00010000:2.0:1787381494.938424:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea103f0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95393b expref: 45 pid: 5792 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381494.938471:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 66 00000100:00100000:2.0:1787381494.938480:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645ad9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2157c09-10df-40cb-8228-ad4822122c97+45:2349:x1874205047068800:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787381494.938494:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381494.938501:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea103f0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95393b expref: 45 pid: 5792 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381494.938512:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea103f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95393b expref: 45 pid: 5792 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381494.938561:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea103f0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95393b expref: 45 pid: 5792 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381494.938578:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1643af1300) 00010000:00010000:2.0:1787381494.938582:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea1041a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381494.938592:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea1041a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381494.938598:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea1041a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381494.938632:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787381494.938699:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645ad9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2157c09-10df-40cb-8228-ad4822122c97+44:2349:x1874205047068800:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 220us (1290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381494.938708:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 66 00010000:00010000:3.0:1787381494.939691:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea1041a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381494.939703:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea1041a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787381494.939751:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787381494.939755:0:8469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787381494.939779:0:8469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea1041a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381494.939792:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea1041a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381494.939803:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1040c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381494.939809:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1040c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381494.939815:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1040c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381494.939820:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a1600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381494.939823:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1040c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381494.939840:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1040c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381494.939852:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a1643af1d00) 00010000:00010000:3.0:1787381494.939855:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381494.939858:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1040c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381494.939863:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1040c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381494.939876:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea10413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381494.939881:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea10413 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381494.939887:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea10413 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381494.939892:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a0a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381494.939895:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea10413 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381494.939900:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea10413 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381494.939907:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a1650b8fd00) 00010000:00010000:3.0:1787381494.939909:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381494.939912:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea10413 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381494.939928:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea10413 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381494.939971:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1400/0xbdc38ada7ea10405 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953942 expref: 44 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381494.939985:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea1041a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953942 expref: 43 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381494.939992:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1643af1300) 00010000:00010000:3.0:1787381494.939995:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787381494.939997:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16413a1800, rc 0) 00000100:00100000:3.0:1787381494.940651:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1543324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+43:11400:x1874205047068416:12345-192.168.203.22@tcp:101:stat.0 Request processed in 30189us (31154us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381494.940661:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 156 00000100:00100000:1.0:1787381495.085945:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381495.086984:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047069056 00000100:00100000:2.0:1787381495.086997:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047069056 00000100:00100000:2.0:1787381495.087155:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 157 00000100:00100000:2.0:1787381495.089395:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+43:11408:x1874205047069056:12345-192.168.203.22@tcp:36:truncate.0 00010000:00010000:2.0:1787381495.089463:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381495.089492:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea1041a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953942 expref: 43 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381495.089513:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1643af1300) 00010000:00010000:2.0:1787381495.089517:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787381495.089923:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10421 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381495.089936:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10421 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381495.089945:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10421 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787381495.089995:0:5792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1787381495.090508:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f3aef2ea reply state 00000000f4d6f570 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10421 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381495.090519:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787381495.090778:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645ad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+45:11408:x1874205047069056:12345-192.168.203.22@tcp:36:truncate.0 Request processed in 3613us (4840us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1787381495.090787:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 157 00000020:00080000:2.0:1787381495.090792:0:5792:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787381495.101787:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10421 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.101881:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10421 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.101891:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10421 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.101898:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a0e00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381495.101903:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10421 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.101911:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10421 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.101944:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1643af1300) 00010000:00010000:3.0:1787381495.101948:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381495.101953:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10421 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.101960:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10421 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381495.331734:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381495.331827:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047069184 00000100:00100000:3.0:1787381495.331837:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047069184 00000100:00100000:3.0:1787381495.331894:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 158 00000100:00100000:3.0:1787381495.331903:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645adb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+44:11422:x1874205047069184:12345-192.168.203.22@tcp:101:stat.0 00010000:00010000:3.0:1787381495.331927:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381495.331946:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea10428 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953949 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.332042:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea1042f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.332055:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea1042f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.332065:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea1042f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.332078:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea10436 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.332084:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea10436 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.332121:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea10436 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.333339:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea1043d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.333353:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea1043d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.333363:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea1043d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787381495.333401:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1787381495.333405:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787381495.333425:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea1043d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.333438:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea1043d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.333446:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea1042f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.333452:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea1042f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.333458:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea1042f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.333464:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb1200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381495.333468:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea1042f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.333487:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea1042f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.333501:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a1643af1d00) 00010000:00010000:3.0:1787381495.333504:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381495.333507:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea1042f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.333513:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea1042f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.333526:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea10436 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.333532:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea10436 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.333537:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea10436 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.333542:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb0200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381495.333544:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea10436 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.333550:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea10436 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.333557:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a1643052500) 00010000:00010000:3.0:1787381495.333559:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381495.333562:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea10436 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.333577:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea10436 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.333616:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea10428 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953949 expref: 46 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.333630:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea1043d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953949 expref: 45 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.333637:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1643af1300) 00010000:00010000:3.0:1787381495.333639:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787381495.333642:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb1800, rc 0) 00000100:00100000:3.0:1787381495.333720:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645adb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+45:11422:x1874205047069184:12345-192.168.203.22@tcp:101:stat.0 Request processed in 1817us (1994us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381495.333729:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 158 00000100:00100000:0.0:1787381495.428861:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381495.428945:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047069440 00000100:00100000:3.0:1787381495.428955:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047069440 00000100:00100000:3.0:1787381495.429057:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 159 00000100:00100000:3.0:1787381495.429068:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1543327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+45:11432:x1874205047069440:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1787381495.429089:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381495.429108:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea10444 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953950 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787381495.429246:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787381495.429360:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea10444 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953950 expref: 47 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.429391:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1650b8f100) 00010000:00010000:3.0:1787381495.429394:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787381495.429399:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea10444 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953950 expref: 47 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.429414:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb0a00, rc 0) 00000100:00100000:3.0:1787381495.429486:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1543327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+46:11432:x1874205047069440:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 419us (635us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1787381495.429494:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 159 00000100:00100000:1.0:1787381495.435803:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381495.435995:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047069696 00000100:00100000:0.0:1787381495.436047:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047069696 00000100:00100000:0.0:1787381495.436113:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 44 00000100:00100000:0.0:1787381495.436123:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166d3bb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+46:11432:x1874205047069696:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:0.0:1787381495.436382:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166d3bb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+47:11432:x1874205047069696:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 260us (588us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1787381495.436393:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 44 00000100:00100000:2.0:1787381495.534692:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381495.534820:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047069952 00000100:00100000:3.0:1787381495.534831:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047069952 00000100:00100000:3.0:1787381495.534892:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 160 00000100:00100000:3.0:1787381495.534903:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+47:11438:x1874205047069952:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:3.0:1787381495.534927:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381495.534947:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea10452 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953957 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.535082:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea10459 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.535097:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea1043d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953949 expref: 48 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.535105:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea10459 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.535135:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea1043d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953949 expref: 48 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.535160:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea1043d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953949 expref: 48 pid: 5790 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381495.535174:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1681720380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1874205065944832:192.168.203.22@tcp:104: 00000100:00100000:3.0:1787381495.535328:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a164fe86000 going to sleep for 11 seconds 00000100:00100000:1.0:1787381495.541786:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381495.541924:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047070080 00000100:00100000:2.0:1787381495.541934:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047070080 00010000:00010000:2.0:1787381495.541978:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea1043d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953949 expref: 49 pid: 5790 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381495.542085:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 67 00000100:00100000:2.0:1787381495.542096:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645adad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+49:2349:x1874205047070080:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787381495.542110:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381495.542117:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea1043d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953949 expref: 49 pid: 5790 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381495.542146:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea1043d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953949 expref: 49 pid: 5790 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381495.542178:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1643af1300) 00010000:00010000:2.0:1787381495.542183:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea10459 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381495.542298:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea10459 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381495.542305:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea10459 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381495.542324:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787381495.542375:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645adad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+49:2349:x1874205047070080:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 280us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381495.542384:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 67 00010000:00010000:3.0:1787381495.545816:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea1043d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953949 expref: 48 pid: 5790 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381495.545998:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1681720380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1874205065944832:192.168.203.22@tcp:104: 00010000:00010000:3.0:1787381495.546064:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea10459 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.546074:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea10459 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.546079:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea10459 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787381495.546100:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1787381495.546272:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea10452 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953957 expref: 49 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.546288:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea10459 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953957 expref: 48 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.546297:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1643af1300) 00010000:00010000:3.0:1787381495.546315:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787381495.546319:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb0200, rc 0) 00000100:00100000:3.0:1787381495.546385:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a804380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+48:11438:x1874205047069952:12345-192.168.203.22@tcp:101:bash.0 Request processed in 11483us (11714us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1787381495.546393:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 160 00000100:00100000:1.0:1787381495.549704:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381495.549782:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047070336 00000100:00100000:3.0:1787381495.549792:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047070336 00000100:00100000:3.0:1787381495.549856:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 161 00000100:00100000:3.0:1787381495.549867:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+48:11438:x1874205047070336:12345-192.168.203.22@tcp:36:bash.0 00010000:00010000:3.0:1787381495.550195:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10467 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.550273:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10467 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.550286:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10467 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787381495.550342:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1787381495.550367:0:5790:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ee83d13a reply state 00000000ef598c85 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10467 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381495.550377:0:5790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787381495.550474:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645ad9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+51:11438:x1874205047070336:12345-192.168.203.22@tcp:36:bash.0 Request processed in 608us (778us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1787381495.550483:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 161 00000020:00080000:3.0:1787381495.550488:0:5790:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787381495.552737:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10467 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381495.552754:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10467 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381495.552761:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10467 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381495.552767:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb1200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381495.552771:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10467 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381495.552780:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10467 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381495.552796:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1643af1300) 00010000:00010000:1.0:1787381495.552799:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381495.552803:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10467 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381495.552809:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10467 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381495.558481:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381495.558843:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047070464 00000100:00100000:2.0:1787381495.558853:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047070464 00000100:00100000:2.0:1787381495.558959:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 162 00000100:00100000:2.0:1787381495.558971:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645adbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+50:11438:x1874205047070464:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:2.0:1787381495.558993:0:11324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381495.559057:0:11324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea1046e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a95395e expref: -99 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381495.559142:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10475 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381495.559181:0:11324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea10459 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953957 expref: 51 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381495.559204:0:11324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10475 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381495.559240:0:11324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea10459 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953957 expref: 51 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381495.559253:0:11324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea10459 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953957 expref: 51 pid: 5792 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381495.559267:0:11324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a804e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11324:1874205065944960:192.168.203.22@tcp:104: 00000100:00100000:2.0:1787381495.559345:0:11324:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1658251e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787381495.562558:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381495.562621:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047070592 00000100:00100000:1.0:1787381495.562631:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047070592 00010000:00010000:1.0:1787381495.562699:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea10459 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953957 expref: 52 pid: 5792 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381495.562749:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 68 00000100:00100000:1.0:1787381495.562764:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1681720380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+52:2349:x1874205047070592:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787381495.562779:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381495.562786:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea10459 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953957 expref: 52 pid: 5792 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381495.562801:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea10459 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953957 expref: 52 pid: 5792 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381495.562825:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1643af1300) 00010000:00010000:1.0:1787381495.562832:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10475 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381495.562842:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10475 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381495.562851:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10475 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381495.562870:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381495.562935:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1681720380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+52:2349:x1874205047070592:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 175us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381495.562962:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 68 00010000:00010000:2.0:1787381495.564612:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea10459 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953957 expref: 51 pid: 5792 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381495.564633:0:11324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a804e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11324:1874205065944960:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787381495.564655:0:11324:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10475 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381495.564663:0:11324:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10475 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381495.564680:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10475 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787381495.564735:0:11324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787381495.564757:0:11324:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787381495.564783:0:11324:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10475 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381495.564815:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea1046e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95395e expref: 51 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381495.564830:0:11324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10475 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95395e expref: 50 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381495.564839:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1643af1300) 00010000:00010000:2.0:1787381495.564841:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787381495.564844:0:11324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16413a0e00, rc 0) 00000100:00100000:2.0:1787381495.564909:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645adbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+50:11438:x1874205047070464:12345-192.168.203.22@tcp:101:bash.0 Request processed in 5940us (6436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381495.564917:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 162 00000100:00100000:3.0:1787381495.573596:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381495.573705:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047070848 00000100:00100000:0.0:1787381495.573715:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047070848 00000100:00100000:0.0:1787381495.573775:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 45 00000100:00100000:0.0:1787381495.573785:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1681721500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+50:11438:x1874205047070848:12345-192.168.203.22@tcp:35:bash.0 00000100:00100000:0.0:1787381495.574173:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1681721500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+51:11438:x1874205047070848:12345-192.168.203.22@tcp:35:bash.0 Request processed in 389us (586us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1787381495.574181:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 45 00010000:00010000:2.0:1787381495.692175:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787381495.703801:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381495.703902:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047071104 00000100:00100000:3.0:1787381495.703928:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047071104 00000100:00100000:3.0:1787381495.703996:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 163 00000100:00100000:3.0:1787381495.704042:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645adaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+51:11448:x1874205047071104:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1787381495.704068:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381495.704089:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea1047c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953965 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787381495.704220:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787381495.704338:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea1047c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953965 expref: 53 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.704352:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1650b8f100) 00010000:00010000:3.0:1787381495.704355:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787381495.704360:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea1047c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953965 expref: 53 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381495.704373:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb0a00, rc 0) 00000100:00100000:3.0:1787381495.704438:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645adaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+52:11448:x1874205047071104:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 399us (647us total) trans 4294967451 rc 301/301 00000100:00100000:3.0:1787381495.704445:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 163 00000100:00100000:1.0:1787381495.709423:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381495.709578:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047071232 00000100:00100000:0.0:1787381495.709589:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047071232 00000100:00100000:0.0:1787381495.709650:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 164 00000100:00100000:0.0:1787381495.709661:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645ada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+52:11448:x1874205047071232:12345-192.168.203.22@tcp:34:lfs.0 00010000:00010000:0.0:1787381495.709737:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea1048a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381495.709753:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea1048a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381495.709765:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea1048a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381495.709779:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea10491 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381495.709787:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea10491 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381495.709805:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea10491 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381495.709898:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea10498 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381495.709907:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea10498 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381495.709926:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea10498 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787381495.709968:0:8469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea10498 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381495.709980:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea1048a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381495.709987:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea1048a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381495.709994:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea1048a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381495.710033:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c9a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787381495.710038:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea1048a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381495.710046:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea1048a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381495.710058:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a1643af1d00) 00010000:00010000:0.0:1787381495.710067:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787381495.710072:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea1048a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381495.710079:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea1048a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381495.710095:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea10491 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381495.710101:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea10491 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381495.710106:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea10491 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381495.710111:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c8a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787381495.710114:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea10491 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381495.710119:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea10491 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381495.710126:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a1643af1700) 00010000:00010000:0.0:1787381495.710128:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787381495.710130:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea10491 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381495.710135:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea10491 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381495.710154:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea10498 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381495.710189:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea10498 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381495.710194:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea10498 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381495.710199:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c9000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787381495.710202:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea10498 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381495.710208:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea10498 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381495.710217:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1643af1300) 00010000:00010000:0.0:1787381495.710220:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787381495.710222:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea10498 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381495.710228:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea10498 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381495.710305:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645ada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+52:11448:x1874205047071232:12345-192.168.203.22@tcp:34:lfs.0 Request processed in 644us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381495.710313:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 164 00000100:00100000:1.0:1787381495.714286:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381495.719572:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047071488 00000100:00100000:3.0:1787381495.719586:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047071488 00000100:00100000:2.0:1787381495.719811:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00100000:2.0:1787381495.719821:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+52:11448:x1874205047071488:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:2.0:1787381495.720106:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+53:11448:x1874205047071488:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 284us (5826us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1787381495.720115:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00100000:2.0:1787381495.777404:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381495.777505:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047071744 00000100:00100000:1.0:1787381495.777514:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047071744 00000100:00100000:1.0:1787381495.777584:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 165 00000100:00100000:1.0:1787381495.777596:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+53:11451:x1874205047071744:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1787381495.777619:0:11324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381495.777637:0:11324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea1049f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a95396c expref: -99 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381495.777708:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea104a6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381495.777722:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea104a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381495.777734:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea104a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381495.777749:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea104ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381495.777757:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea104ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381495.777763:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea104ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381495.777905:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea104b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381495.777915:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea104b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381495.777923:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea104b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787381495.777934:0:11324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787381495.778066:0:11324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea104a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381495.778074:0:11324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea104a6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381495.778081:0:11324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea104a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381495.778087:0:11324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381495.778092:0:11324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea104a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381495.778100:0:11324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea104a6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381495.778112:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a1643af1d00) 00010000:00010000:1.0:1787381495.778114:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381495.778119:0:11324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea104a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381495.778135:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea104a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381495.778147:0:11324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea104ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381495.778154:0:11324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea104ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381495.778160:0:11324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea104ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381495.778165:0:11324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388c00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381495.778167:0:11324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea104ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381495.778173:0:11324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea104ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381495.778180:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a1659f89e00) 00010000:00010000:1.0:1787381495.778183:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381495.778185:0:11324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea104ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381495.778191:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea104ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381495.778300:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea1049f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95396c expref: 56 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381495.778324:0:11324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea104b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95396c expref: 55 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381495.778330:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1643af1300) 00010000:00010000:1.0:1787381495.778333:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787381495.778335:0:11324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541389000, rc 0) 00000100:00100000:1.0:1787381495.778401:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a804e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+55:11451:x1874205047071744:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 808us (1006us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1787381495.778408:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 165 00000100:00100000:1.0:1787381495.784299:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381495.784425:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047071872 00000100:00100000:0.0:1787381495.784437:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047071872 00000100:00100000:0.0:1787381495.784503:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 166 00000100:00100000:0.0:1787381495.784512:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+55:11451:x1874205047071872:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:0.0:1787381495.784575:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea104c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381495.784604:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea104c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381495.784615:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea104c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381495.784643:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea104c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381495.784648:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea104c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381495.784655:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea104c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381495.784660:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c9000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787381495.784664:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea104c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381495.784671:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea104c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381495.784682:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1643af1300) 00010000:00010000:0.0:1787381495.784685:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787381495.784689:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea104c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381495.784695:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea104c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381495.784770:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+55:11451:x1874205047071872:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 258us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381495.784784:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 166 00000100:00100000:2.0:1787381495.786921:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381495.787493:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381495.787559:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047072256 00000100:00100000:0.0:1787381495.787568:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047072256 00000100:00100000:0.0:1787381495.787618:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:0.0:1787381495.787627:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1681722300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+55:11451:x1874205047072256:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:0.0:1787381495.787862:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1681722300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+56:11451:x1874205047072256:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 227us (362us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1787381495.787870:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:1.0:1787381495.788715:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047072000 00000100:00100000:1.0:1787381495.788724:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047072000 00000100:00100000:1.0:1787381495.790409:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:1.0:1787381495.790441:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+56:2350:x1874205047072000:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787381495.790460:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381495.790488:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea104b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95396c expref: 56 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381495.790510:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1643af1300) 00010000:00010000:1.0:1787381495.790515:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381495.790665:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+55:2350:x1874205047072000:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 243us (3811us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381495.790674:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:3.0:1787381495.956571:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381495.956611:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381495.956642:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381495.956686:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381495.956720:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047072768 00000100:00100000:3.0:1787381495.956742:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047072768 00000100:00100000:3.0:1787381495.956797:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 150 00000100:00100000:3.0:1787381495.956806:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1681721180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2349:x1874205047072768:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381495.956884:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1681721180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2349:x1874205047072768:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 78us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381495.956892:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 150 00000100:00080000:3.0:1787381495.956912:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787381495.957958:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047072640 00000100:00100000:0.0:1787381495.957969:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047072640 00000100:00080000:3.0:1787381495.958034:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787381495.958075:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047072512 00000100:00100000:0.0:1787381495.958079:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047072512 00000100:00100000:0.0:1787381495.958105:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 73 00000100:00100000:0.0:1787381495.958112:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1681723480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+7:2349:x1874205047072640:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787381495.958170:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1681723480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+7:2349:x1874205047072640:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 57us (1558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381495.958177:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 73 00000100:00100000:0.0:1787381495.958191:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 74 00000100:00100000:0.0:1787381495.958197:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1681720e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+6:2349:x1874205047072512:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787381495.958232:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1681720e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+6:2349:x1874205047072512:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 35us (1590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381495.958237:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 74 00000100:00100000:1.0:1787381495.958444:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047072384 00000100:00100000:1.0:1787381495.958448:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047072384 00000100:00100000:1.0:1787381495.958513:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 295 00000100:00100000:1.0:1787381495.958522:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2349:x1874205047072384:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787381495.958553:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2349:x1874205047072384:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 33us (1993us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381495.958559:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 295 00000100:00080000:3.0:1787381495.958685:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787381496.024099:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381496.024450:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047073024 00000100:00100000:2.0:1787381496.024461:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047073024 00000100:00100000:2.0:1787381496.024549:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 167 00000100:00100000:2.0:1787381496.024560:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1681720700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+55:11469:x1874205047073024:12345-192.168.203.22@tcp:101:cat.0 00010000:00010000:2.0:1787381496.024597:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381496.024615:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea104c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953973 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.024707:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea104d0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.024721:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea104d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.024733:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea104d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787381496.024749:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787381496.024873:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea104c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953973 expref: 58 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.024893:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea104d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953973 expref: 57 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.024901:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1643af1300) 00010000:00010000:2.0:1787381496.024904:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787381496.024908:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16413a0a00, rc 0) 00000100:00100000:2.0:1787381496.024976:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1681720700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+57:11469:x1874205047073024:12345-192.168.203.22@tcp:101:cat.0 Request processed in 418us (885us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1787381496.024984:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 167 00000100:00080000:3.0:1787381496.038584:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787381496.099821:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381496.102147:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047073152 00000100:00100000:0.0:1787381496.102176:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047073152 00000100:00100000:0.0:1787381496.102272:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 168 00000100:00100000:0.0:1787381496.102305:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+57:11470:x1874205047073152:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1787381496.102332:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381496.102352:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea104de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a95397a expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381496.102434:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea104e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381496.102448:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea104e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381496.102459:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea104e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787381496.102532:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787381496.102536:0:8469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787381496.102561:0:8469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea104e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381496.102589:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea104de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95397a expref: 59 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381496.102607:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea104e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95397a expref: 58 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381496.102615:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a1643af1d00) 00010000:00010000:0.0:1787381496.102618:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787381496.102622:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16460c8a00, rc 0) 00000100:00100000:0.0:1787381496.102702:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+58:11470:x1874205047073152:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 400us (2890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381496.102719:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 168 00000100:00100000:1.0:1787381496.113145:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381496.113249:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047073536 00000100:00100000:0.0:1787381496.113259:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047073536 00000100:00100000:0.0:1787381496.113321:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 48 00000100:00100000:0.0:1787381496.113331:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+58:11470:x1874205047073536:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:0.0:1787381496.113689:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+59:11470:x1874205047073536:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 358us (552us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1787381496.113698:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 48 00000100:00100000:1.0:1787381496.123175:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381496.123571:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047073664 00000100:00100000:3.0:1787381496.123582:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047073664 00000100:00100000:3.0:1787381496.123649:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:3.0:1787381496.123658:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1665875450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2157c09-10df-40cb-8228-ad4822122c97+59:11470:x1874205047073664:12345-192.168.203.22@tcp:103:lfs.0 00010000:00010000:3.0:1787381496.123683:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787381496.123708:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10475 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95395e expref: 59 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381496.123775:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea104d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953973 expref: 58 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381496.123793:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8600/0xbdc38ada7ea10380 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95391f expref: 57 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381496.123803:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1643af1300) 00010000:00010000:3.0:1787381496.123827:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787381496.123893:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1665875450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2157c09-10df-40cb-8228-ad4822122c97+56:11470:x1874205047073664:12345-192.168.203.22@tcp:103:lfs.0 Request processed in 235us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381496.123900:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:1.0:1787381496.126610:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381496.126811:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047073792 00000100:00100000:3.0:1787381496.126823:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047073792 00000100:00100000:3.0:1787381496.126964:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 169 00000100:00100000:3.0:1787381496.126975:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+56:11470:x1874205047073792:12345-192.168.203.22@tcp:58:lfs.0 00010000:00010000:3.0:1787381496.127388:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea104ec lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381496.127411:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea104ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381496.127429:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea104ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787381496.127629:0:11324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1787381496.127745:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+56:11470:x1874205047073792:12345-192.168.203.22@tcp:58:lfs.0 Request processed in 768us (1140us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381496.127754:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 169 00000100:00100000:1.0:1787381496.160443:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381496.160484:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047073920 00000100:00100000:1.0:1787381496.160495:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047073920 00000100:00100000:1.0:1787381496.160549:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 170 00000100:00100000:1.0:1787381496.160561:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+56:11472:x1874205047073920:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1787381496.160583:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381496.160603:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea104f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953981 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.160671:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea104fa lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.160685:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea104fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.160696:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea104fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.160712:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea10501 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.160734:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea10501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.160741:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea10501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.160836:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea10508 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.160846:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea10508 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.160872:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea10508 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787381496.164335:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787381496.164344:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787381496.164372:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea10508 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.164390:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea10508 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.164401:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea104fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.164409:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea104fa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.164417:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea104fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.164441:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541389e00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381496.164446:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea104fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.164453:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea104fa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.164468:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a1643af1d00) 00010000:00010000:1.0:1787381496.164471:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381496.164475:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea104fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.164482:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea104fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.164498:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea10501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.164504:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea10501 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.164511:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea10501 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.164517:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541389600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381496.164520:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea10501 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.164526:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea10501 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.164544:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a1659f89500) 00010000:00010000:1.0:1787381496.164547:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381496.164550:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea10501 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.164557:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea10501 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.164599:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea104f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953981 expref: 58 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.164612:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea10508 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953981 expref: 57 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.164620:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1643052500) 00010000:00010000:1.0:1787381496.164622:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787381496.164625:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541389800, rc 0) 00000100:00100000:1.0:1787381496.164697:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+57:11472:x1874205047073920:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 4140us (4264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381496.164706:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 170 00000001:00080000:3.0:1787381496.206545:0:7481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:3.0:1787381496.208176:0:7481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00010000:00010000:2.0:1787381496.725849:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787381496.758910:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000004:00080000:0.0:1787381496.758992:0:5813:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1787381496.759278:0:5813:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a164fe866c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1787381496.759284:0:5813:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9a167f4d8400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a164fe86e40 00000020:00080000:0.0:1787381496.759288:0:5813:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9a167f4d8500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a167f4c1400 00000020:00080000:0.0:1787381496.759310:0:5825:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:2.0:1787381496.759481:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16600c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065945088:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787381496.759569:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381496.759634:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065945088 00000100:00100000:2.0:1787381496.759642:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065945088 00000100:00080000:3.0:1787381496.759676:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787381496.759701:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787381496.759709:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065945088:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787381496.759733:0:6588:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:2.0:1787381496.759763:0:6588:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8946f4, atime: 0x6a8946f4, ctime: 0x6a8946f4, blocks: 0xb 00010000:00010000:2.0:1787381496.759771:0:6588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000304ef184/0xbdc38ada7ea1050f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.759786:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=354s v=(0 0) 00010000:00010000:2.0:1787381496.759790:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787381496.759796:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000304ef184/0xbdc38ada7ea1050f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.759812:0:6588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000304ef184/0xbdc38ada7ea1050f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.759821:0:6588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000304ef184/0xbdc38ada7ea1050f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.759829:0:6588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000304ef184/0xbdc38ada7ea1050f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.759844:0:6588:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787381496.760453:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:3.0:1787381496.760459:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:3.0:1787381496.760486:0:3310:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9a16600c7480 x1874205065945088/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787381512 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1787381496.760497:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a16600c7480/2, rc 0, transno 4294967307 00000100:00100000:3.0:1787381496.760508:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16600c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065945088:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787381496.760586:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1874205065945088:12345-0@lo:6:osp-syn-1-0.0 Request processed in 680us (820us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787381496.760604:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:2.0:1787381496.760627:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787381496.760632:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000304ef184/0xbdc38ada7ea1050f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.760638:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a1400 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:2.0:1787381496.760642:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000304ef184/0xbdc38ada7ea1050f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.760648:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000304ef184/0xbdc38ada7ea1050f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.760661:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000304ef184/0xbdc38ada7ea1050f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.760665:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000304ef184/0xbdc38ada7ea1050f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.760677:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381496.760678:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381496.760679:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787381496.762296:0:5825:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000040:00080000:1.0:1787381496.780649:0:11528:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787381496.780657:0:11528:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787381496.780713:0:11528:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787381496.780720:0:11528:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787381496.780832:0:11528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1645adce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11528:1874205065945216:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787381496.780927:0:11528:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f689240 going to sleep for 11 seconds 00000100:00100000:1.0:1787381496.784531:0:11528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1645adce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11528:1874205065945216:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787381496.791391:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381496.791514:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047074048 00000100:00100000:1.0:1787381496.791523:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047074048 00000100:00100000:1.0:1787381496.791691:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 171 00000100:00100000:1.0:1787381496.791701:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+16:11483:x1874205047074048:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787381496.791731:0:5791:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787381496.791846:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+16:11483:x1874205047074048:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 145us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381496.791854:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 171 00000100:00100000:1.0:1787381496.803132:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381496.804482:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047074176 00000100:00100000:2.0:1787381496.804662:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047074176 00000100:00100000:2.0:1787381496.804773:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 172 00000100:00100000:2.0:1787381496.804784:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+16:11483:x1874205047074176:12345-192.168.203.22@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787381496.804873:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1400/0xbdc38ada7ea10516 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.804889:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1400/0xbdc38ada7ea10516 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.804900:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1400/0xbdc38ada7ea10516 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.804960:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea1051d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.804969:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea1051d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.804991:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea1051d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.805053:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea10524 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.805062:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea10524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.805068:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea10524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787381496.805106:0:11324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787381496.805110:0:11324:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787381496.805123:0:11324:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea10524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.805133:0:11324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1400/0xbdc38ada7ea10516 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.805146:0:11324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1400/0xbdc38ada7ea10516 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.805153:0:11324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1400/0xbdc38ada7ea10516 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.805168:0:11324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a1400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381496.805173:0:11324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1400/0xbdc38ada7ea10516 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.805181:0:11324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1400/0xbdc38ada7ea10516 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.805193:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a1643052000) 00010000:00010000:2.0:1787381496.805196:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381496.805202:0:11324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1400/0xbdc38ada7ea10516 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.805208:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1400/0xbdc38ada7ea10516 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.805222:0:11324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea1051d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.805227:0:11324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea1051d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.805232:0:11324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea1051d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.805237:0:11324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a1800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381496.805247:0:11324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea1051d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.805253:0:11324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea1051d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.805261:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9a1650b8f800) 00010000:00010000:2.0:1787381496.805263:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381496.805266:0:11324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea1051d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.805271:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea1051d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.805285:0:11324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea10524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.805291:0:11324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea10524 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.805297:0:11324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea10524 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.805302:0:11324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a1600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381496.805305:0:11324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea10524 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.805311:0:11324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea10524 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.805319:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1643052500) 00010000:00010000:2.0:1787381496.805321:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381496.805330:0:11324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea10524 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.805337:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea10524 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381496.808149:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+16:11483:x1874205047074176:12345-192.168.203.22@tcp:34:lhsmtool_posix.0 Request processed in 3357us (5016us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381496.808173:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 172 00000100:00100000:0.0:1787381496.811387:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381496.811474:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047074432 00000100:00100000:1.0:1787381496.811483:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047074432 00000100:00100000:1.0:1787381496.811541:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 173 00000100:00100000:1.0:1787381496.811552:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1543326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+16:11483:x1874205047074432:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787381496.811573:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381496.811593:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea1052b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953988 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.811707:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea10532 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.811721:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea10532 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.811733:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea10532 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787381496.811744:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787381496.811924:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea10532 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.811941:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea10532 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.811948:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea10532 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.811954:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541389c00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381496.811958:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea10532 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.811966:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea10532 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.811979:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1643052500) 00010000:00010000:1.0:1787381496.811982:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787381496.811987:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea10532 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.811992:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea10532 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.812075:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea1052b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953988 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.812086:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a1643052000) 00010000:00010000:1.0:1787381496.812088:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787381496.812092:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea1052b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953988 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.812101:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541389e00, rc 0) 00000100:00100000:1.0:1787381496.812184:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1543326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+17:11483:x1874205047074432:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 634us (805us total) trans 4294967457 rc 301/301 00000100:00100000:1.0:1787381496.812192:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 173 00000100:00100000:3.0:1787381496.817385:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381496.818091:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047074560 00000100:00100000:2.0:1787381496.818102:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047074560 00000100:00100000:2.0:1787381496.818167:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 174 00000100:00100000:2.0:1787381496.818178:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+17:11483:x1874205047074560:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787381496.818216:0:5792:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787381496.818326:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+17:11483:x1874205047074560:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 149us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381496.818334:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 174 00000100:00100000:0.0:1787381496.824386:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381496.825309:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047074816 00000100:00100000:1.0:1787381496.825323:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047074816 00000100:00100000:1.0:1787381496.825388:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 175 00000100:00100000:1.0:1787381496.825398:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1543325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+17:11483:x1874205047074816:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787381496.825421:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381496.825425:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787381496.825453:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea104e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95397a expref: 17 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.825473:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a1643af1d00) 00010000:00010000:1.0:1787381496.825478:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787381496.825492:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea10540 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a95398f expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787381496.826889:0:5790:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1787381496.827939:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea10547 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381496.827958:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea10547 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381496.827970:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea10547 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381496.828630:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea10540 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95398f expref: 19 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381496.828744:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea10547 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95398f expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381496.828755:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a1643af1600) 00010000:00010000:0.0:1787381496.828758:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787381496.828762:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16460c8400, rc 0) 00000100:00100000:0.0:1787381496.828884:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1543325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+18:11483:x1874205047074816:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 3487us (4506us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1787381496.828895:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 175 00000100:00100000:0.0:1787381496.834532:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381496.834643:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047075072 00000100:00100000:3.0:1787381496.834652:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047075072 00000100:00100000:3.0:1787381496.834711:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 176 00000100:00100000:3.0:1787381496.834721:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1543325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+18:11483:x1874205047075072:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787381496.834780:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787381496.834809:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea10547 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95398f expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381496.834829:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a1643af1600) 00010000:00010000:3.0:1787381496.834841:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787381496.834864:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10555 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381496.834876:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10555 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381496.834886:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10555 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381496.834947:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea1055c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xe309a4a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381496.834955:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea1055c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe309a4a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381496.834962:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea1055c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe309a4a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381496.835617:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10555 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381496.835628:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10555 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381496.835634:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10555 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381496.835640:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb1200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381496.835644:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10555 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381496.835652:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10555 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381496.835664:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a1643af1d00) 00010000:00010000:3.0:1787381496.835667:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381496.835671:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10555 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381496.835678:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10555 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381496.835688:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea1055c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe309a4a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381496.835694:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea1055c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe309a4a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381496.835700:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea1055c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe309a4a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381496.835713:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb0800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381496.835716:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea1055c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe309a4a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381496.835723:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea1055c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe309a4a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381496.835732:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xe309a4a1 (ffff9a1643052300) 00010000:00010000:3.0:1787381496.835735:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381496.835738:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea1055c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe309a4a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381496.835745:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea1055c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe309a4a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381496.835943:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1543325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+17:11483:x1874205047075072:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 1219us (1415us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787381496.835954:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 176 00000100:00100000:2.0:1787381496.842260:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381496.842352:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047075200 00000100:00100000:1.0:1787381496.842363:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047075200 00000100:00100000:1.0:1787381496.842449:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 177 00000100:00100000:1.0:1787381496.842459:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+17:11483:x1874205047075200:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787381496.842481:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381496.842505:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea10563 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953996 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.842541:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea1056a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.842573:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea1056a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.842584:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea1056a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.842692:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea10563 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953996 expref: 19 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.842712:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea1056a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953996 expref: 18 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381496.842733:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a1659f89100) 00010000:00010000:1.0:1787381496.842735:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787381496.842739:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541388800, rc 0) 00000100:00100000:1.0:1787381496.842799:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+18:11483:x1874205047075200:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 342us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381496.842806:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 177 00000100:00100000:0.0:1787381496.847490:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381496.848057:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047075456 00000100:00100000:2.0:1787381496.848070:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047075456 00000100:00100000:2.0:1787381496.848301:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 178 00000100:00100000:2.0:1787381496.848317:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1543326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+18:11483:x1874205047075456:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787381496.848401:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea10571 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.848419:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea10571 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.848431:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea10571 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787381496.848738:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:2.0:1787381496.848749:0:5790:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 354979743443ns, next at 355979741488ns, rc = 0 00000004:00010000:2.0:1787381496.848838:0:5790:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007c17b7bb reply state 0000000040de31b9 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea10571 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381496.848848:0:5790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787381496.848942:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1543326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+20:11483:x1874205047075456:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 630us (1462us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1787381496.856458:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 178 00000100:00100000:0.0:1787381496.859494:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381496.859533:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047075584 00000100:00100000:0.0:1787381496.859542:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047075584 00000100:00100000:0.0:1787381496.859595:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 179 00000100:00100000:0.0:1787381496.859604:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1543326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+20:11483:x1874205047075584:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787381496.859628:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381496.859652:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10578 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a95399d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381496.859726:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10578 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95399d expref: 21 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381496.859741:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10578 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95399d expref: 21 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381496.859783:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a1659f89100) 00010000:00010000:0.0:1787381496.859787:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787381496.859791:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16460c8800, rc 0) 00000100:00100000:0.0:1787381496.859844:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1543326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+21:11483:x1874205047075584:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 241us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381496.859851:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 179 00000100:00100000:1.0:1787381496.864111:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381496.865352:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047075712 00000100:00100000:3.0:1787381496.865365:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047075712 00000100:00100000:3.0:1787381496.865420:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 51 00000100:00100000:3.0:1787381496.865430:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645add180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2157c09-10df-40cb-8228-ad4822122c97+6:2349:x1874205047075712:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787381496.865754:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645add180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2157c09-10df-40cb-8228-ad4822122c97+7:2349:x1874205047075712:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 Request processed in 324us (1650us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1787381496.865761:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 51 00010000:00010000:2.0:1787381496.870380:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea10571 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.870399:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea10571 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.870408:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea10571 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.870414:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a1600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381496.870419:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea10571 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.870427:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea10571 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.870447:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a1659f89100) 00010000:00010000:2.0:1787381496.870450:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787381496.870454:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea10571 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381496.870477:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea10571 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381496.870509:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381496.870833:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047075968 00000100:00100000:3.0:1787381496.870845:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047075968 00000100:00100000:3.0:1787381496.870908:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 49 00000100:00100000:3.0:1787381496.870918:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+20:11483:x1874205047075968:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787381496.872641:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+21:11483:x1874205047075968:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 1716us (2127us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1787381496.872655:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 49 00000100:00100000:3.0:1787381496.875799:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381496.876255:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047076224 00000100:00100000:1.0:1787381496.876265:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047076224 00000100:00100000:1.0:1787381496.876328:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 180 00000100:00100000:1.0:1787381496.876338:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+21:11483:x1874205047076224:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787381496.876717:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+21:11483:x1874205047076224:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 379us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381496.876725:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 180 00000100:00100000:1.0:1787381496.883144:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381496.885316:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047076352 00000100:00100000:0.0:1787381496.885328:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047076352 00000100:00100000:0.0:1787381496.885394:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 181 00000100:00100000:0.0:1787381496.885404:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645ade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+21:11483:x1874205047076352:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787381496.885424:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381496.885444:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8000/0xbdc38ada7ea1057f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9539a4 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381496.885509:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8c00/0xbdc38ada7ea10586 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381496.885523:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8c00/0xbdc38ada7ea10586 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381496.885534:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8c00/0xbdc38ada7ea10586 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787381496.885572:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787381496.885589:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8c00/0xbdc38ada7ea10586 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381496.885616:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8000/0xbdc38ada7ea1057f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539a4 expref: 23 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381496.885642:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8c00/0xbdc38ada7ea10586 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539a4 expref: 22 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381496.885649:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a1659f89100) 00010000:00010000:0.0:1787381496.885652:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787381496.885656:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16460c8c00, rc 0) 00000100:00100000:1.0:1787381496.887430:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645ade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+22:11483:x1874205047076352:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 2019us (4285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381496.887443:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 181 00000100:00100000:2.0:1787381496.900859:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381496.904630:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047076480 00000100:00100000:0.0:1787381496.904644:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047076480 00000100:00100000:0.0:1787381496.904716:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 52 00000100:00100000:0.0:1787381496.904726:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+7:2350:x1874205047076480:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787381496.904745:0:6588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381496.904769:0:6588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9d6b413/0xbdc38ada7ea1058d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9539ab expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787381496.904797:0:6588:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8946f7, blocks: 0x1 00010000:00010000:0.0:1787381496.904816:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=355s v=(0 0) 00010000:00010000:0.0:1787381496.904821:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381496.904832:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9d6b413/0xbdc38ada7ea1058d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539ab expref: 8 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381496.904851:0:6588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e9d6b413/0xbdc38ada7ea1058d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539ab expref: 8 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381496.904865:0:6588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16460c8000, rc 0) 00000100:00100000:0.0:1787381496.904937:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+8:2350:x1874205047076480:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 212us (4087us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381496.904955:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 52 00000100:00100000:3.0:1787381496.908739:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381496.908830:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047076736 00000100:00100000:0.0:1787381496.908841:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047076736 00000100:00100000:0.0:1787381496.908911:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 182 00000100:00100000:0.0:1787381496.908922:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+22:11483:x1874205047076736:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787381496.909070:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+22:11483:x1874205047076736:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 150us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381496.909078:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 182 00000100:00100000:2.0:1787381496.912498:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381496.912575:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047076864 00000100:00100000:3.0:1787381496.912585:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047076864 00000100:00100000:3.0:1787381496.912640:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 53 00000100:00100000:3.0:1787381496.912649:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2157c09-10df-40cb-8228-ad4822122c97+8:11483:x1874205047076864:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787381496.912666:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381496.912684:0:6587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da9994f5/0xbdc38ada7ea10594 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9539b2 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381496.912713:0:6587:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9d6b413/0xbdc38ada7ea1058d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539ab expref: 9 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381496.912722:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787381496.912726:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787381496.912733:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da9994f5/0xbdc38ada7ea10594 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539b2 expref: 9 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381496.912764:0:6587:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e9d6b413/0xbdc38ada7ea1058d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539ab expref: 9 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381496.912779:0:6587:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e9d6b413/0xbdc38ada7ea1058d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539ab expref: 9 pid: 6588 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381496.912804:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16600c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6587:1874205065945344:192.168.203.22@tcp:104: 00000100:00100000:3.0:1787381496.912896:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167a372b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787381496.923726:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381496.923761:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047076992 00000100:00100000:3.0:1787381496.923770:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047076992 00010000:00010000:3.0:1787381496.923807:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e9d6b413/0xbdc38ada7ea1058d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539ab expref: 10 pid: 6588 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381496.923840:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 69 00000100:00100000:3.0:1787381496.923850:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+10:2350:x1874205047076992:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787381496.923864:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787381496.923885:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e9d6b413/0xbdc38ada7ea1058d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539ab expref: 10 pid: 6588 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381496.923900:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e9d6b413/0xbdc38ada7ea1058d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539ab expref: 10 pid: 6588 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381496.923927:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787381496.923932:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787381496.923940:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000da9994f5/0xbdc38ada7ea10594 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539b2 expref: 10 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381496.923951:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da9994f5/0xbdc38ada7ea10594 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539b2 expref: 10 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381496.924027:0:5775:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000da9994f5/0xbdc38ada7ea10594 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539b2 expref: 10 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381496.924043:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16600c5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5775:1874205065945472:192.168.203.22@tcp:105: 00010000:00010000:0.0:1787381496.924117:0:6587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9d6b413/0xbdc38ada7ea1058d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539ab expref: 10 pid: 6588 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381496.924130:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16600c6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6587:1874205065945344:192.168.203.22@tcp:104: 00000100:00100000:3.0:1787381496.924142:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167a372780 going to sleep for 11 seconds 00010000:00010000:0.0:1787381496.924155:0:6587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000da9994f5/0xbdc38ada7ea10594 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539b2 expref: 9 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381496.924176:0:6587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb0200, rc 0) 00000100:00100000:0.0:1787381496.924207:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2157c09-10df-40cb-8228-ad4822122c97+9:11483:x1874205047076864:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 11558us (11716us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381496.924216:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 53 00000100:00100000:1.0:1787381496.929247:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16600c5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5775:1874205065945472:192.168.203.22@tcp:105: 00010000:00010000:1.0:1787381496.929277:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381496.929388:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+8:2350:x1874205047076992:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 5537us (5669us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381496.929398:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 69 00000100:00100000:2.0:1787381496.938294:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381496.938357:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047077120 00000100:00100000:2.0:1787381496.938366:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047077120 00002000:00100000:3.0:1787381496.942749:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9a167a6c9c00 x1874205047077120/t0(0) o4->f2157c09-10df-40cb-8228-ad4822122c97@192.168.203.22@tcp:547/0 lens 504/0 e 0 to 0 dl 1787381507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787381496.942766:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a167a6c9c00 with x1874205047077120 ext(0->8) 00002000:00010000:3.0:1787381496.942773:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a167a6c9c00 00000100:00100000:3.0:1787381496.942805:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:3.0:1787381496.942815:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f2157c09-10df-40cb-8228-ad4822122c97+8:2350:x1874205047077120:12345-192.168.203.22@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787381496.943258:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f2157c09-10df-40cb-8228-ad4822122c97+10:2350:x1874205047077120:12345-192.168.203.22@tcp:4:lhsmtool_posix.0 Request processed in 443us (4972us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1787381496.943267:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 4 00002000:00100000:3.0:1787381496.943273:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9a167a6c9c00 x1874205047077120/t4294967314(0) o4->f2157c09-10df-40cb-8228-ad4822122c97@192.168.203.22@tcp:547/0 lens 504/448 e 0 to 0 dl 1787381507 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787381496.943282:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a167a6c9c00 with x1874205047077120 ext(0->8) 00002000:00010000:3.0:1787381496.943285:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a167a6c9c00 00000100:00100000:3.0:1787381496.948467:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381496.949492:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047077248 00000100:00100000:1.0:1787381496.949504:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047077248 00000100:00100000:1.0:1787381496.949573:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 183 00000100:00100000:1.0:1787381496.949582:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+22:11483:x1874205047077248:12345-192.168.203.22@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787381497.021422:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000001:00080000:0.0:1787381497.021443:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:0.0:1787381497.021447:0:5813:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000001:00080000:0.0:1787381497.021460:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:0.0:1787381497.021466:0:5813:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:0.0:1787381497.021653:0:5825:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1787381497.021675:0:5825:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1787381497.021683:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787381497.021703:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167ab43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065945600:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787381497.021770:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381497.021828:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065945600 00000100:00100000:0.0:1787381497.021835:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065945600 00000100:00100000:0.0:1787381497.021896:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787381497.021905:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065945600:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787381497.022081:0:6588:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787381497.022085:0:6588:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787381495 00002000:00010000:0.0:1787381497.022088:0:6588:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787381497.022090:0:6588:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787381495 -> 1787381495 00002000:00010000:0.0:1787381497.022092:0:6588:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787381497.022131:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1874205065945600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 227us (360us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787381497.022138:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1787381497.022667:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1787381497.022709:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a167ab43b80/2, rc 0, transno 4294967315 00000100:00100000:0.0:1787381497.022716:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167ab43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065945600:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787381497.022910:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+18:11483:x1874205047077248:12345-192.168.203.22@tcp:44:lhsmtool_posix.0 Request processed in 73325us (74446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381497.022921:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 183 00000100:00100000:1.0:1787381497.041376:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381497.044380:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047077376 00000100:00100000:2.0:1787381497.044396:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047077376 00000100:00100000:2.0:1787381497.044506:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:2.0:1787381497.044516:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645add500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2157c09-10df-40cb-8228-ad4822122c97+10:2349:x1874205047077376:12345-192.168.203.22@tcp:16:lhsmtool_posix.0 00000040:00080000:1.0:1787381497.045400:0:12301:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787381497.045407:0:12301:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787381497.045467:0:12301:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787381497.045473:0:12301:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00080000:0.0:1787381497.049383:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787381497.097644:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645add500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2157c09-10df-40cb-8228-ad4822122c97+10:2349:x1874205047077376:12345-192.168.203.22@tcp:16:lhsmtool_posix.0 Request processed in 53117us (56264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381497.097658:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 55 00000001:00080000:1.0:1787381497.098243:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:1.0:1787381497.098270:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:3.0:1787381497.116687:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381497.117224:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047077632 00000100:00100000:1.0:1787381497.117235:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047077632 00000100:00100000:1.0:1787381497.117293:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 184 00000100:00100000:1.0:1787381497.117304:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+18:11483:x1874205047077632:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787381497.117363:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381497.117390:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8c00/0xbdc38ada7ea10586 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539a4 expref: 18 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381497.117410:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a1659f89100) 00010000:00010000:1.0:1787381497.117415:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787381497.117446:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea1059b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381497.117462:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea1059b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381497.117472:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea1059b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787381497.117720:0:5790:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008e599667 reply state 000000004cb63fec transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea1059b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381497.117730:0:5790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787381497.117835:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+19:11483:x1874205047077632:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 532us (1155us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1787381497.117842:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 184 00000100:00100000:0.0:1787381497.124682:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381497.124817:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047077760 00000100:00100000:3.0:1787381497.124828:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047077760 00000100:00100000:3.0:1787381497.124893:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 56 00000100:00100000:3.0:1787381497.124904:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+7:2352:x1874205047077760:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 00010000:00010000:1.0:1787381497.124923:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea1059b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381497.124943:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea1059b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381497.124950:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea1059b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381497.124956:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541389a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381497.124960:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea1059b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381497.124966:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea1059b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381497.124988:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a1659f89100) 00010000:00010000:1.0:1787381497.124999:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381497.125022:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea1059b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381497.125029:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea1059b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787381497.125251:0:6588:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787381497.125255:0:6588:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787381495 -> 1787381494 00002000:00010000:3.0:1787381497.125257:0:6588:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787381492 00002000:00010000:3.0:1787381497.125259:0:6588:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787381495 -> 1787381494 00002000:00010000:3.0:1787381497.125261:0:6588:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787381497.125325:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+8:2352:x1874205047077760:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 Request processed in 421us (652us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787381497.125334:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 56 00000100:00100000:3.0:1787381497.142330:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381497.142407:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047078016 00000100:00100000:2.0:1787381497.142418:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047078016 00000100:00100000:2.0:1787381497.142482:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 185 00000100:00100000:2.0:1787381497.142492:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+18:11483:x1874205047078016:12345-192.168.203.22@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787381497.142565:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea105a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381497.142584:0:5792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea1056a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953996 expref: 18 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381497.142593:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea105a2 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381497.142639:0:5792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea1056a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953996 expref: 18 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381497.142652:0:5792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea1056a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953996 expref: 18 pid: 8469 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381497.142667:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6cbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1874205065945728:192.168.203.22@tcp:104: 00000100:00100000:2.0:1787381497.142754:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a164599a300 going to sleep for 11 seconds 00000100:00100000:3.0:1787381497.145477:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381497.145520:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6cbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5792:1874205065945728:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787381497.145546:0:5792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea105a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381497.146189:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047078144 00000100:00100000:0.0:1787381497.146199:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047078144 00010000:00010000:0.0:1787381497.146235:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea1056a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953996 expref: 19 pid: 8469 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381497.146272:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 70 00000100:00100000:0.0:1787381497.146284:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645adb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+19:2350:x1874205047078144:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787381497.146310:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787381497.146319:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea1056a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953996 expref: 19 pid: 8469 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381497.146333:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea1056a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953996 expref: 19 pid: 8469 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381497.146357:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea1056a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953996 expref: 19 pid: 8469 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381497.146371:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a1659f89100) 00010000:00010000:0.0:1787381497.146377:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea105a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381497.146387:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea105a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381497.146395:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea105a2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381497.146425:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787381497.146481:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645adb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+18:2350:x1874205047078144:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 200us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381497.146490:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 70 00010000:00010000:2.0:1787381497.146976:0:5792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea105a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381497.146985:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea105a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381497.147046:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea105a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381497.147055:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea105a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381497.147061:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea105a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381497.147067:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a0a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381497.147072:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea105a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381497.147089:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea105a2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381497.147101:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a1659f89100) 00010000:00010000:2.0:1787381497.147104:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787381497.147109:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea105a2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381497.147115:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea105a2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381497.147180:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+17:11483:x1874205047078016:12345-192.168.203.22@tcp:55:lhsmtool_posix.0 Request processed in 4688us (4859us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787381497.147188:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 185 00000100:00100000:3.0:1787381497.152334:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381497.153195:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047078272 00000100:00100000:0.0:1787381497.153208:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047078272 00000100:00100000:0.0:1787381497.153273:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 57 00000100:00100000:0.0:1787381497.153283:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645ad9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2157c09-10df-40cb-8228-ad4822122c97+8:2351:x1874205047078272:12345-192.168.203.22@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787381497.153345:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e9d6b413/0xbdc38ada7ea105a9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381497.153368:0:6587:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da9994f5/0xbdc38ada7ea10594 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539b2 expref: 8 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381497.153378:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381497.153382:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787381497.153387:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9d6b413/0xbdc38ada7ea105a9 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381497.153423:0:6587:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000da9994f5/0xbdc38ada7ea10594 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539b2 expref: 8 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381497.153439:0:6587:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000da9994f5/0xbdc38ada7ea10594 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539b2 expref: 8 pid: 6587 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381497.153453:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16600eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6587:1874205065945856:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787381497.153542:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a15437e8000 going to sleep for 11 seconds 00000100:00100000:3.0:1787381497.162088:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381497.162157:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047078400 00000100:00100000:2.0:1787381497.162167:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047078400 00010000:00010000:2.0:1787381497.162204:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000da9994f5/0xbdc38ada7ea10594 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539b2 expref: 9 pid: 6587 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381497.162249:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 71 00000100:00100000:2.0:1787381497.162259:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645adad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+9:2349:x1874205047078400:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787381497.162272:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381497.162295:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000da9994f5/0xbdc38ada7ea10594 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539b2 expref: 9 pid: 6587 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381497.162326:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000da9994f5/0xbdc38ada7ea10594 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539b2 expref: 9 pid: 6587 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381497.162370:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787381497.162374:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787381497.162381:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9d6b413/0xbdc38ada7ea105a9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381497.162390:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9d6b413/0xbdc38ada7ea105a9 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381497.162411:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787381497.162460:0:6587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da9994f5/0xbdc38ada7ea10594 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539b2 expref: 9 pid: 6587 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381497.162470:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645adad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+9:2349:x1874205047078400:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 202us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381497.162479:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16600eb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6587:1874205065945856:192.168.203.22@tcp:104: 00000100:00100000:2.0:1787381497.162483:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 71 00010000:00010000:1.0:1787381497.162504:0:6587:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e9d6b413/0xbdc38ada7ea105a9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381497.162516:0:6587:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e9d6b413/0xbdc38ada7ea105a9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381497.162531:0:6587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9d6b413/0xbdc38ada7ea105a9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381497.162555:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e9d6b413/0xbdc38ada7ea105a9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381497.162564:0:6587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9d6b413/0xbdc38ada7ea105a9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381497.162572:0:6587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9d6b413/0xbdc38ada7ea105a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381497.162579:0:6587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c8000 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:1.0:1787381497.162584:0:6587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9d6b413/0xbdc38ada7ea105a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381497.162593:0:6587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9d6b413/0xbdc38ada7ea105a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381497.162606:0:6587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9d6b413/0xbdc38ada7ea105a9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381497.162613:0:6587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9d6b413/0xbdc38ada7ea105a9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381497.162680:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645ad9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2157c09-10df-40cb-8228-ad4822122c97+7:2351:x1874205047078272:12345-192.168.203.22@tcp:1:lhsmtool_posix.0 Request processed in 9399us (10532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381497.162688:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 57 00000100:00100000:0.0:1787381497.171900:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381497.171963:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047078656 00000100:00100000:1.0:1787381497.171974:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047078656 00000100:00100000:1.0:1787381497.172074:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 186 00000100:00100000:1.0:1787381497.172085:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+17:11483:x1874205047078656:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787381497.172171:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea105b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381497.172187:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea105b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381497.172212:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea105b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381497.172416:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea105b7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381497.172427:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10578 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95399d expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381497.172436:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea105b7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381497.172473:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10578 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95399d expref: 18 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381497.172507:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10578 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95399d expref: 18 pid: 5791 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381497.172521:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1645adc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1874205065945984:192.168.203.22@tcp:104: 00000100:00100000:1.0:1787381497.172609:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f6899c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787381497.177581:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381497.177696:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1645adc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1874205065945984:192.168.203.22@tcp:104: 00010000:00010000:1.0:1787381497.177723:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea105b7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381497.177837:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047078784 00000100:00100000:2.0:1787381497.177845:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047078784 00010000:00010000:2.0:1787381497.177879:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10578 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95399d expref: 19 pid: 5791 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381497.177914:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 72 00000100:00100000:2.0:1787381497.177924:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1681720380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+19:2349:x1874205047078784:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787381497.177937:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381497.177943:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10578 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95399d expref: 19 pid: 5791 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381497.177953:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10578 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95399d expref: 19 pid: 5791 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381497.178027:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea10578 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a95399d expref: 19 pid: 5791 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381497.178043:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a1659f89100) 00010000:00010000:2.0:1787381497.178048:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea105b7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381497.178057:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea105b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381497.178063:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea105b7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381497.178087:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787381497.178140:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1681720380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+18:2349:x1874205047078784:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 217us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381497.178148:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 72 00010000:00010000:3.0:1787381497.178253:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea105b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381497.178260:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea105b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787381497.178449:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1787381497.178613:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1787381497.178659:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1787381497.178754:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f933480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1874205065946112:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787381497.178801:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381497.178833:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167a3726c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787381497.178948:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065946112 00000100:00100000:2.0:1787381497.178953:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065946112 00000100:00100000:2.0:1787381497.178999:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787381497.179044:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f932680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8469:x1874205065946112:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787381497.179106:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f932680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8469:x1874205065946112:12345-0@lo:1000:mdt00_003.0 Request processed in 64us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381497.179113:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787381497.179447:0:8469:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1787381497.179462:0:8469:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a167ab43b80, transno 4294967315 00000100:00100000:3.0:1787381497.179484:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f933480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1874205065946112:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1787381497.179934:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1787381497.180054:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f933480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1874205065946240:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787381497.180095:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381497.180118:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167a372f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787381497.180523:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065946240 00000100:00100000:2.0:1787381497.180529:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065946240 00000100:00100000:2.0:1787381497.180578:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787381497.180587:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f931500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8469:x1874205065946240:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787381497.180760:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f931500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8469:x1874205065946240:12345-0@lo:1000:mdt00_003.0 Request processed in 174us (664us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1787381497.180768:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787381497.180920:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f933480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1874205065946240:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1787381497.180951:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea105b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381497.180960:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea105b7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381497.180968:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea105b7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381497.180973:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388c00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381497.180977:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea105b7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381497.180985:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea105b7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381497.184712:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a1659f89100) 00010000:00010000:3.0:1787381497.184722:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787381497.184730:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea105b7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381497.184741:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea105b7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381497.184793:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea104ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381497.184801:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea104ec lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381497.184807:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea104ec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381497.184812:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb0a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381497.184816:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea104ec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381497.184823:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea104ec lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381497.184834:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1643052500) 00010000:00010000:3.0:1787381497.184837:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787381497.184840:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea104ec lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381497.184846:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea104ec lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381497.184869:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea105be lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381497.184885:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea10508 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953981 expref: 21 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381497.184893:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea105be lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381497.184938:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea10508 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953981 expref: 21 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381497.184954:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea10508 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953981 expref: 21 pid: 5790 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381497.184968:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f932a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1874205065946368:192.168.203.22@tcp:104: 00000100:00100000:3.0:1787381497.185070:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167a372f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787381497.189763:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f932a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1874205065946368:192.168.203.22@tcp:104: 00010000:00010000:0.0:1787381497.189792:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea105be lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381497.198922:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381497.203768:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047078912 00000100:00100000:3.0:1787381497.203782:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047078912 00010000:00010000:3.0:1787381497.203825:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea10508 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953981 expref: 22 pid: 5790 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381497.203868:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 73 00000100:00100000:3.0:1787381497.203878:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2157c09-10df-40cb-8228-ad4822122c97+22:2350:x1874205047078912:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787381497.203892:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787381497.203898:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea10508 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953981 expref: 22 pid: 5790 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381497.203911:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea10508 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953981 expref: 22 pid: 5790 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381497.203933:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea10508 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953981 expref: 22 pid: 5790 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381497.203946:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1643052500) 00010000:00010000:3.0:1787381497.203961:0:5776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea105be lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381497.203972:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea105be lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381497.203980:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea105be lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381497.204049:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787381497.204107:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2157c09-10df-40cb-8228-ad4822122c97+21:2350:x1874205047078912:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 230us (5191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381497.204115:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 73 00010000:00010000:1.0:1787381497.206916:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea105be lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381497.206934:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea105be lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381497.206948:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea105be lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381497.206955:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea105be lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381497.206963:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea105be lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381497.206969:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb1800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381497.206973:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea105be lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381497.206980:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea105be lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381497.207061:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1643052500) 00010000:00010000:1.0:1787381497.207064:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381497.207069:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea105be lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381497.207075:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea105be lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381497.207089:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea105b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381497.207095:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea105b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381497.207100:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea105b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381497.207105:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541389a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381497.207108:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea105b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381497.207114:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea105b0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381497.207122:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1643052500) 00010000:00010000:1.0:1787381497.207125:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787381497.207128:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea105b0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381497.207133:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389a00/0xbdc38ada7ea105b0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381497.207392:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+20:11483:x1874205047078656:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 35304us (35493us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1787381497.207403:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 186 00000020:00080000:1.0:1787381497.207408:0:8469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787381497.207823:0:11528:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787381497.207829:0:11528:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787381497.208375:0:11528:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1787381497.208384:0:11528:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787381497.213880:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381497.213949:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047079168 00000100:00100000:2.0:1787381497.213959:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047079168 00000100:00100000:2.0:1787381497.214042:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 50 00000100:00100000:2.0:1787381497.214051:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166d3ba050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+20:11483:x1874205047079168:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787381497.214757:0:5794:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787381497.214863:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1787381497.214915:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea105c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381497.214933:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea105c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381497.214943:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea105c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381497.214952:0:5794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea105c5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381497.214958:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea105c5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381497.214964:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea105c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381497.215002:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787381497.215122:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166d3ba050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+22:11483:x1874205047079168:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 1070us (1247us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1787381497.215131:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 50 00000020:00080000:2.0:1787381497.215136:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787381497.215185:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787381497.215192:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea105c5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381497.215198:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a0a00 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:2.0:1787381497.215203:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea105c5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381497.215211:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea105c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381497.215224:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9a1650b8fa00) 00010000:00010000:2.0:1787381497.215227:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787381497.215232:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea105c5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381497.215237:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea105c5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381497.215252:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381497.215253:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381497.215255:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381497.740150:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381498.765505:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787381499.152815:0:12354:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787381499.152825:0:12354:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787381499.152858:0:12354:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787381499.152864:0:12354:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787381499.212546:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1645adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065946496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787381499.212623:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381499.212735:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065946496 00000100:00100000:1.0:1787381499.212745:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065946496 00000100:00100000:1.0:1787381499.212813:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787381499.212824:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a7a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1874205065946496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787381499.212861:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787381499.212911:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a7a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1874205065946496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381499.212918:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1787381499.213551:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787381499.213604:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1645adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065946496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787381499.213762:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f931f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd19486c-5291-4823-bb9c-f3a73416a496:3309:1874205065946624:0@lo:400:kworker.0 00000100:00100000:3.0:1787381499.213795:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f930380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1874205065946880:0@lo:400:kworker.0 00000100:00100000:1.0:1787381499.215156:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874205065946752:0@lo:400:kworker.0 00000100:00100000:2.0:1787381499.215219:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f932a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1874205065947008:0@lo:400:kworker.0 00000100:00100000:3.0:1787381499.215633:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381499.217822:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065946880 00000100:00100000:3.0:1787381499.217836:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065946880 00000100:00100000:3.0:1787381499.218531:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787381499.218553:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f6ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874205065946880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381499.218796:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381499.218847:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065947136:0@lo:400:kworker.0 00000100:00100000:3.0:1787381499.218876:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f6ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874205065946880:12345-0@lo:400:kworker.0 Request processed in 334us (3242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381499.218889:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:3.0:1787381499.218921:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787381499.219143:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381499.226129:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381499.226236:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065947008 00000100:00100000:2.0:1787381499.226250:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065947008 00000100:00100000:2.0:1787381499.226312:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787381499.226323:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874205065947008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381499.226388:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874205065947008:12345-0@lo:400:kworker.0 Request processed in 67us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381499.226396:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787381499.226675:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f932a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1874205065947008:0@lo:400:kworker.0 00000100:00080000:2.0:1787381499.226804:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787381499.227079:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065946624 00000100:00100000:2.0:1787381499.227086:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065946624 00000100:00100000:2.0:1787381499.227120:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1787381499.227128:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+19:3309:x1874205065946624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381499.227346:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cd19486c-5291-4823-bb9c-f3a73416a496+19:3309:x1874205065946624:12345-0@lo:400:kworker.0 Request processed in 218us (8550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381499.227354:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1787381499.231917:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381499.231965:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065946752 00000100:00100000:1.0:1787381499.231974:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065946752 00000100:00100000:1.0:1787381499.232048:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787381499.232059:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874205065946752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381499.233902:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874205065946752:12345-0@lo:400:kworker.0 Request processed in 1839us (1986us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381499.233918:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787381499.234128:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874205065946752:0@lo:400:kworker.0 00000100:00100000:0.0:1787381499.237234:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065947136 00000100:00100000:0.0:1787381499.237247:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065947136 00000100:00100000:0.0:1787381499.237319:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787381499.237330:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1874205065947136:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787381499.237373:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787381499.237405:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1874205065947136:12345-0@lo:400:kworker.0 Request processed in 77us (18261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381499.237413:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787381499.237475:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065947136:0@lo:400:kworker.0 00000100:00100000:0.0:1787381499.237490:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f931f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd19486c-5291-4823-bb9c-f3a73416a496:3309:1874205065946624:0@lo:400:kworker.0 00000100:00100000:3.0:1787381499.240283:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f930380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1874205065946880:0@lo:400:kworker.0 00000100:00100000:3.0:1787381499.352833:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381499.352880:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047079424 00000100:00100000:3.0:1787381499.352890:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047079424 00000100:00100000:3.0:1787381499.352952:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 187 00000100:00100000:3.0:1787381499.352962:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f6b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+22:11501:x1874205047079424:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1787381499.352997:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381499.353035:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea105cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9539b9 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381499.353546:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea105d3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381499.353562:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea105d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381499.353576:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea105d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787381499.353588:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1787381499.353759:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea105cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539b9 expref: 25 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381499.353779:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea105d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539b9 expref: 24 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381499.353788:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a1643af1d00) 00010000:00010000:3.0:1787381499.353790:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787381499.353794:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb0a00, rc 0) 00000100:00100000:3.0:1787381499.354494:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f6b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+24:11501:x1874205047079424:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 1528us (1665us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1787381499.354505:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 187 00000100:00080000:3.0:1787381499.354541:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787381499.360538:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381499.360643:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047079552 00000100:00100000:1.0:1787381499.360656:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047079552 00000100:00100000:1.0:1787381499.360740:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 188 00000100:00100000:1.0:1787381499.360750:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+24:11501:x1874205047079552:12345-192.168.203.22@tcp:34:lfs.0 00010000:00010000:1.0:1787381499.360824:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea105e1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.360906:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea105e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.360920:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea105e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.360937:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea105e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.360944:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea105e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.360951:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea105e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.361714:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea105ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.361728:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea105ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.361737:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea105ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787381499.361776:0:11324:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea105ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.361799:0:11324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea105e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.361805:0:11324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea105e1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.361811:0:11324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea105e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.361817:0:11324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381499.361822:0:11324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea105e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.361829:0:11324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea105e1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.362095:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a1643af1d00) 00010000:00010000:1.0:1787381499.362100:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381499.362104:0:11324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea105e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.362112:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea105e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.362125:0:11324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea105e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.362131:0:11324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea105e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.362339:0:11324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea105e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.362352:0:11324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381499.362355:0:11324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea105e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.362361:0:11324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea105e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.362369:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a1659f89900) 00010000:00010000:1.0:1787381499.362371:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381499.362374:0:11324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea105e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.362380:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea105e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.362394:0:11324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea105ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.362400:0:11324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea105ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.362405:0:11324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea105ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.362409:0:11324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381499.362411:0:11324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea105ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.362416:0:11324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea105ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.362495:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1659f89500) 00010000:00010000:1.0:1787381499.362498:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381499.362502:0:11324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea105ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.362508:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea105ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381499.362632:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+24:11501:x1874205047079552:12345-192.168.203.22@tcp:34:lfs.0 Request processed in 1879us (2100us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381499.362641:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 188 00000100:00100000:3.0:1787381499.453058:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381499.453333:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047079808 00000100:00100000:1.0:1787381499.453345:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047079808 00000100:00100000:2.0:1787381499.456904:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 189 00000100:00100000:2.0:1787381499.456930:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f6b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+24:11504:x1874205047079808:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1787381499.456954:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381499.456987:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea105f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9539c0 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.457112:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea105fd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.457153:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea105fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.457165:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea105fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.457182:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1400/0xbdc38ada7ea10604 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.457190:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1400/0xbdc38ada7ea10604 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.457197:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1400/0xbdc38ada7ea10604 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.458363:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1060b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.458379:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1060b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.458389:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1060b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787381499.458401:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787381499.458776:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea105fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.458786:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea105fd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.458895:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea105fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.458911:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a0a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381499.458915:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea105fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.458922:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea105fd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.458934:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a1643af1d00) 00010000:00010000:2.0:1787381499.458937:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381499.458941:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea105fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.458947:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea105fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.459061:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1400/0xbdc38ada7ea10604 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.459077:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1400/0xbdc38ada7ea10604 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.459083:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1400/0xbdc38ada7ea10604 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.459088:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a1400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381499.459091:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1400/0xbdc38ada7ea10604 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.459096:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1400/0xbdc38ada7ea10604 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.459116:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a1650b8f800) 00010000:00010000:2.0:1787381499.459119:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381499.459122:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1400/0xbdc38ada7ea10604 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.459127:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1400/0xbdc38ada7ea10604 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.459449:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea105f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539c0 expref: 27 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.479527:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1060b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539c0 expref: 26 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.479545:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1650b8fa00) 00010000:00010000:2.0:1787381499.479548:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787381499.479552:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16413a1600, rc 0) 00000100:00100000:2.0:1787381499.480339:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f6b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+26:11504:x1874205047079808:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 23418us (27330us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1787381499.480350:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 189 00000100:00100000:3.0:1787381499.494826:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381499.495283:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047079936 00000100:00100000:2.0:1787381499.495293:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047079936 00000100:00100000:2.0:1787381499.495403:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 190 00000100:00100000:2.0:1787381499.495415:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f6baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+26:11504:x1874205047079936:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:2.0:1787381499.495484:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10619 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.495500:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10619 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.495526:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10619 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.495553:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10619 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.495561:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10619 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.495567:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10619 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.495572:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a0e00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381499.495577:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10619 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.495583:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10619 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.495595:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1650b8fa00) 00010000:00010000:2.0:1787381499.495598:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787381499.495602:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10619 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.495608:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10619 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381499.495684:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f6baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+26:11504:x1874205047079936:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 271us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381499.495692:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 190 00000100:00100000:0.0:1787381499.499401:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381499.499834:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047080192 00000100:00100000:2.0:1787381499.499856:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047080192 00000100:00100000:2.0:1787381499.499913:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 51 00000100:00100000:2.0:1787381499.499923:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+26:11504:x1874205047080192:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:2.0:1787381499.500199:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+27:11504:x1874205047080192:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 276us (805us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1787381499.500207:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 51 00000100:00100000:3.0:1787381499.580723:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381499.580991:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047080448 00000100:00100000:1.0:1787381499.581001:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047080448 00000100:00100000:1.0:1787381499.581894:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 191 00000100:00100000:1.0:1787381499.581924:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f6b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+27:11030:x1874205047080448:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:1.0:1787381499.581958:0:11324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381499.581995:0:11324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10620 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9539c7 expref: -99 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.582486:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10627 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.582503:0:11324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1060b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539c0 expref: 28 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.582512:0:11324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10627 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.582768:0:11324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1060b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539c0 expref: 28 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.582785:0:11324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1060b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539c0 expref: 28 pid: 5790 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381499.582876:0:11324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1645addf80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11324:1874205065947264:192.168.203.22@tcp:104: 00000100:00100000:1.0:1787381499.583080:0:11324:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f689cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787381499.589156:0:11324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1645addf80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11324:1874205065947264:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787381499.589198:0:11324:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10627 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381499.590580:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381499.591052:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047080576 00000100:00100000:1.0:1787381499.591063:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047080576 00010000:00010000:1.0:1787381499.591122:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1060b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539c0 expref: 29 pid: 5790 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381499.591178:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 74 00000100:00100000:1.0:1787381499.591444:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f6b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+29:2350:x1874205047080576:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787381499.591467:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381499.591475:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1060b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539c0 expref: 29 pid: 5790 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.591489:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1060b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539c0 expref: 29 pid: 5790 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.591512:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1060b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539c0 expref: 29 pid: 5790 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.591530:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1650b8fa00) 00010000:00010000:1.0:1787381499.591548:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10627 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.591567:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10627 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.591574:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10627 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.591606:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381499.591675:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f6b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+28:2350:x1874205047080576:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 487us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381499.591684:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 74 00010000:00010000:2.0:1787381499.591922:0:11324:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10627 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.591931:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10627 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787381499.591950:0:11324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787381499.592173:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10620 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539c7 expref: 29 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.592204:0:11324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10627 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539c7 expref: 28 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.592213:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1650b8fa00) 00010000:00010000:2.0:1787381499.592216:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787381499.592219:0:11324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541388600, rc 0) 00000100:00100000:2.0:1787381499.592253:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f6b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+28:11030:x1874205047080448:12345-192.168.203.22@tcp:101:bash.0 Request processed in 10341us (11541us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1787381499.592272:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 191 00000100:00100000:1.0:1787381499.599036:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381499.599262:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047080832 00000100:00100000:2.0:1787381499.599274:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047080832 00000100:00100000:2.0:1787381499.599326:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 192 00000100:00100000:2.0:1787381499.599336:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+28:11030:x1874205047080832:12345-192.168.203.22@tcp:36:bash.0 00010000:00010000:2.0:1787381499.599618:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10635 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.599636:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10635 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.599647:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10635 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787381499.599699:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1787381499.599725:0:5790:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006cd79349 reply state 00000000279310ba transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10635 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381499.599734:0:5790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787381499.599785:0:5790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1787381499.600449:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645adc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+32:11030:x1874205047080832:12345-192.168.203.22@tcp:36:bash.0 Request processed in 1110us (1448us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1787381499.600458:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 192 00000020:00080000:2.0:1787381499.600464:0:5790:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787381499.606734:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381499.606826:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047080960 00000100:00100000:3.0:1787381499.606835:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047080960 00000100:00100000:3.0:1787381499.606894:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 193 00000100:00100000:3.0:1787381499.606903:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+32:11030:x1874205047080960:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:3.0:1787381499.606925:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381499.606944:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea1063c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9539ce expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381499.607050:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea1063c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539ce expref: 33 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381499.607075:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea1063c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539ce expref: 33 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381499.607095:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1650b8fa00) 00010000:00010000:3.0:1787381499.607098:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787381499.607102:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb1200, rc 0) 00000100:00100000:3.0:1787381499.607167:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+33:11030:x1874205047080960:12345-192.168.203.22@tcp:101:bash.0 Request processed in 264us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381499.607174:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 193 00010000:00010000:2.0:1787381499.607680:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10635 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.607690:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10635 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.607708:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10635 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.607714:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a0e00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381499.607719:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10635 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.607727:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10635 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.607741:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1650b8fa00) 00010000:00010000:2.0:1787381499.607744:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381499.607748:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10635 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.607754:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10635 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381499.613911:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381499.614251:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047081088 00000100:00100000:2.0:1787381499.614261:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047081088 00000100:00100000:2.0:1787381499.614382:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 58 00000100:00100000:2.0:1787381499.614393:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2157c09-10df-40cb-8228-ad4822122c97+7:11030:x1874205047081088:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:2.0:1787381499.614413:0:7779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381499.614438:0:7779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000304ef184/0xbdc38ada7ea10643 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9539d5 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787381499.614468:0:7779:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8946f6, atime: 0x6a8946f4, ctime: 0x6a8946f6, blocks: 0xb 00010000:00010000:2.0:1787381499.614490:0:7779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=357s v=(0 0) 00010000:00010000:2.0:1787381499.614494:0:7779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787381499.614512:0:7779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000304ef184/0xbdc38ada7ea10643 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539d5 expref: 8 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.614533:0:7779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000304ef184/0xbdc38ada7ea10643 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539d5 expref: 8 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.614548:0:7779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16413a1400, rc 0) 00000100:00100000:2.0:1787381499.614638:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2157c09-10df-40cb-8228-ad4822122c97+8:11030:x1874205047081088:12345-192.168.203.22@tcp:101:bash.0 Request processed in 246us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381499.614655:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 58 00000100:00080000:3.0:1787381499.618620:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787381499.619001:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381499.619328:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047081216 00000100:00100000:2.0:1787381499.619341:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047081216 00002000:00010000:2.0:1787381499.619385:0:6595:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1787381499.619391:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a1645adf800 with x1874205047081216 ext(0->18446744073709551615) 00002000:00010000:2.0:1787381499.619402:0:6595:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a1645adf800. 00000100:00100000:2.0:1787381499.619476:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:2.0:1787381499.619486:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645adf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f2157c09-10df-40cb-8228-ad4822122c97+8:2351:x1874205047081216:12345-192.168.203.22@tcp:10:bash.0 00002000:00010000:2.0:1787381499.619785:0:6595:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787381499.619789:0:6595:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787381494 -> 1787381498 00002000:00010000:2.0:1787381499.619803:0:6595:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1787381492 -> 1787381492 00002000:00010000:2.0:1787381499.619806:0:6595:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787381494 -> 1787381498 00002000:00010000:2.0:1787381499.619808:0:6595:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787381499.619917:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645adf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f2157c09-10df-40cb-8228-ad4822122c97+9:2351:x1874205047081216:12345-192.168.203.22@tcp:10:bash.0 Request processed in 432us (918us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1787381499.619926:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 5 00002000:00010000:2.0:1787381499.619930:0:6595:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1787381499.619946:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a1645adf800 with x1874205047081216 ext(0->18446744073709551615) 00002000:00010000:2.0:1787381499.619951:0:6595:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a1645adf800. 00000100:00100000:1.0:1787381499.724482:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f6b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065947392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787381499.724555:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381499.724757:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065947392 00000100:00100000:3.0:1787381499.724766:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065947392 00000100:00100000:3.0:1787381499.724896:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787381499.724907:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874205065947392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787381499.724946:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787381499.725814:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645add880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874205065947392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 905us (1255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381499.725825:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787381499.725998:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f6b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065947392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787381499.746413:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381499.746610:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047081344 00000100:00100000:2.0:1787381499.746620:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047081344 00000100:00100000:2.0:1787381499.746683:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 194 00000100:00100000:2.0:1787381499.746694:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fb25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+32:11518:x1874205047081344:12345-192.168.203.22@tcp:34:lfs.0 00010000:00010000:2.0:1787381499.746766:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea1064a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.746783:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea1064a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.746805:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea1064a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.746821:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea10651 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.746827:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea10651 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.746834:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea10651 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.747763:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea10658 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.748341:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea10658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.748368:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea10658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787381499.748417:0:11324:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea10658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.748431:0:11324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea1064a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.748437:0:11324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea1064a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.748444:0:11324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea1064a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.748450:0:11324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a0e00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381499.748454:0:11324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea1064a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.748460:0:11324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea1064a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.748472:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a1643af1d00) 00010000:00010000:2.0:1787381499.748475:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381499.748479:0:11324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea1064a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.748484:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea1064a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.748498:0:11324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea10651 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.748510:0:11324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea10651 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.748515:0:11324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea10651 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.748519:0:11324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a0a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381499.748522:0:11324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea10651 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.748527:0:11324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea10651 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.748535:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a1650b8fb00) 00010000:00010000:2.0:1787381499.748537:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381499.748540:0:11324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea10651 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.748545:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea10651 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.748560:0:11324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea10658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.748566:0:11324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea10658 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.748573:0:11324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea10658 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.748577:0:11324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a1800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381499.748586:0:11324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea10658 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.748592:0:11324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea10658 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.748601:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1650b8fa00) 00010000:00010000:2.0:1787381499.748603:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381499.748606:0:11324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea10658 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.748612:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea10658 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381499.748964:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fb25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+32:11518:x1874205047081344:12345-192.168.203.22@tcp:34:lfs.0 Request processed in 2268us (2556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381499.748983:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 194 00010000:00010000:2.0:1787381499.788272:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787381499.870722:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381499.870828:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047081600 00000100:00100000:1.0:1787381499.870839:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047081600 00000100:00100000:1.0:1787381499.870899:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 195 00000100:00100000:1.0:1787381499.870909:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fb27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+32:11521:x1874205047081600:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1787381499.870930:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381499.870950:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea1065f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9539dc expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.871061:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea10666 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.871093:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea10666 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.871107:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea10666 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.871124:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea1066d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.871142:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea1066d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.871150:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea1066d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.871870:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea10674 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.871883:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea10674 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.871891:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea10674 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787381499.871902:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787381499.872038:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea10666 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.872046:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea10666 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.872054:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea10666 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.872066:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541389e00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381499.872071:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea10666 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.872079:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea10666 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.872092:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a1643af1d00) 00010000:00010000:1.0:1787381499.872095:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381499.872099:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea10666 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.872105:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea10666 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.872119:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea1066d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.872125:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea1066d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.872131:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea1066d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.872136:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541389600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381499.872138:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea1066d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.872144:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea1066d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.872752:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a1659f89500) 00010000:00010000:1.0:1787381499.872755:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381499.872759:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea1066d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.872764:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea1066d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.872887:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea1065f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539dc expref: 35 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.872903:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea10674 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539dc expref: 34 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381499.872911:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1650b8fa00) 00010000:00010000:1.0:1787381499.872913:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787381499.872916:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541388a00, rc 0) 00000100:00100000:1.0:1787381499.872998:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fb27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+34:11521:x1874205047081600:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 2089us (2288us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1787381499.873061:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 195 00000100:00100000:1.0:1787381499.888316:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381499.889686:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047081728 00000100:00100000:0.0:1787381499.889699:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047081728 00000100:00100000:0.0:1787381499.889768:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 196 00000100:00100000:0.0:1787381499.889779:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+34:11521:x1874205047081728:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:0.0:1787381499.889995:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea10682 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381499.890044:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10627 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539c7 expref: 34 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381499.890075:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea10682 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381499.890112:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10627 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539c7 expref: 34 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381499.890127:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10627 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539c7 expref: 34 pid: 11324 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381499.890286:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166fb25880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1874205065947520:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787381499.890402:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fbac9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787381499.895114:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381499.895274:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047081984 00000100:00100000:2.0:1787381499.895284:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047081984 00000100:00100000:2.0:1787381499.895340:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 52 00000100:00100000:2.0:1787381499.895349:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fb27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+35:5563:x1874205047081984:12345-192.168.203.22@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787381499.895657:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fb27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+36:5563:x1874205047081984:12345-192.168.203.22@tcp:35:ldlm_bl.0 Request processed in 309us (551us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1787381499.895665:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 52 00000100:00100000:3.0:1787381499.897146:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166fb25880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1874205065947520:192.168.203.22@tcp:104: 00010000:00010000:3.0:1787381499.897337:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea10682 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381499.901238:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381499.901900:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047082112 00000100:00100000:2.0:1787381499.901910:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047082112 00010000:00010000:2.0:1787381499.901957:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10627 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539c7 expref: 36 pid: 11324 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381499.902060:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 75 00000100:00100000:2.0:1787381499.902080:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1665874850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+36:2349:x1874205047082112:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787381499.902099:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381499.902106:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10627 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539c7 expref: 36 pid: 11324 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.902119:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10627 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539c7 expref: 36 pid: 11324 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.902162:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10627 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539c7 expref: 36 pid: 11324 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.902180:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1650b8fa00) 00010000:00010000:2.0:1787381499.902184:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea10682 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.902203:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea10682 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.902210:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea10682 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381499.902240:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787381499.902301:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1665874850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+35:2349:x1874205047082112:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 222us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381499.902308:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 75 00010000:00010000:0.0:1787381499.903480:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea10682 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381499.903493:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea10682 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381499.903527:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea10682 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381499.903535:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea10682 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381499.903542:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea10682 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381499.903548:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c9000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787381499.903552:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea10682 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381499.903572:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea10682 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381499.903587:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1650b8fa00) 00010000:00010000:0.0:1787381499.903589:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787381499.903593:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea10682 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381499.903598:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9000/0xbdc38ada7ea10682 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381499.903681:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+34:11521:x1874205047081728:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 13902us (15373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381499.903691:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 196 00000100:00100000:1.0:1787381499.914467:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381499.914631:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047082368 00000100:00100000:2.0:1787381499.914658:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047082368 00000100:00100000:2.0:1787381499.914713:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 53 00000100:00100000:2.0:1787381499.914723:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+34:11521:x1874205047082368:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:2.0:1787381499.914981:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+35:11521:x1874205047082368:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 250us (515us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1787381499.914989:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 53 00000100:00100000:2.0:1787381500.035661:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381500.035753:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047082624 00000100:00100000:1.0:1787381500.035762:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047082624 00000100:00100000:1.0:1787381500.035890:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 197 00000100:00100000:1.0:1787381500.035899:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+35:11532:x1874205047082624:12345-192.168.203.22@tcp:101:cat.0 00010000:00010000:1.0:1787381500.035935:0:11324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381500.035954:0:11324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea10689 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9539e3 expref: -99 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.036062:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10690 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.036077:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10690 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.036088:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10690 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.036102:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea10697 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.036109:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea10697 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.036115:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea10697 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.036458:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea1069e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.036467:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea1069e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.036475:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea1069e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787381500.036485:0:11324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1787381500.036581:0:11324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10690 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.036589:0:11324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10690 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.036595:0:11324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10690 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.036601:0:11324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381500.036606:0:11324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10690 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.036614:0:11324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10690 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.036630:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a1643af1d00) 00010000:00010000:1.0:1787381500.036632:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381500.036637:0:11324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10690 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.036643:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10690 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.036655:0:11324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea10697 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.036661:0:11324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea10697 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.036666:0:11324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea10697 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.036682:0:11324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381500.036685:0:11324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea10697 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.036691:0:11324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea10697 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.036699:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a1659f89500) 00010000:00010000:1.0:1787381500.036700:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381500.036703:0:11324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea10697 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.036708:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea10697 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.036746:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea10689 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539e3 expref: 38 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.036759:0:11324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea1069e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539e3 expref: 37 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.036765:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1650b8fa00) 00010000:00010000:1.0:1787381500.036767:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787381500.036769:0:11324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541388c00, rc 0) 00000100:00100000:1.0:1787381500.039081:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+37:11532:x1874205047082624:12345-192.168.203.22@tcp:101:cat.0 Request processed in 3173us (3418us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1787381500.039095:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 197 00000100:00100000:0.0:1787381500.063384:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381500.063497:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047082880 00000100:00100000:2.0:1787381500.063508:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047082880 00000100:00100000:2.0:1787381500.063572:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 54 00000100:00100000:2.0:1787381500.063583:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fb24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+37:11532:x1874205047082880:12345-192.168.203.22@tcp:35:cat.0 00000100:00100000:2.0:1787381500.063848:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fb24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+38:11532:x1874205047082880:12345-192.168.203.22@tcp:35:cat.0 Request processed in 267us (473us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1787381500.063856:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 54 00000100:00100000:3.0:1787381500.094579:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381500.094732:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047083136 00000100:00100000:2.0:1787381500.094742:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047083136 00000100:00100000:2.0:1787381500.094807:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 198 00000100:00100000:2.0:1787381500.094817:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f6bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+38:11533:x1874205047083136:12345-192.168.203.22@tcp:36:rm.0 00010000:00010000:2.0:1787381500.094879:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787381500.094905:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea1069e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539e3 expref: 38 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.094926:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea10674 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539dc expref: 37 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.094938:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea1063c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539ce expref: 36 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.094964:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1650b8fa00) 00010000:00010000:2.0:1787381500.094984:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787381500.095054:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea106ac lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.095066:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea106ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.095075:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea106ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.095090:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea106b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.095098:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea106b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.095104:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea106b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.096348:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea106ba lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.096367:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea106ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.096376:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea106ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787381500.098285:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1787381500.098299:0:5792:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 358229294027ns, next at 359229290864ns, rc = 0 00010000:00010000:2.0:1787381500.098393:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea106c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.098407:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea106c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.098425:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea106c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.098433:0:5792:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea106c1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.098438:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea106c1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.098444:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea106c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.098475:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787381500.098504:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea106ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.098510:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea106ba lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.098523:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea106ba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.098529:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a1800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381500.098533:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea106ba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.098540:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea106ba lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.098567:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1650b8f500) 00010000:00010000:2.0:1787381500.098570:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787381500.098574:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea106ba lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.098580:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea106ba lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.098604:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea106ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.098609:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea106ac lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.098614:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea106ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.098618:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a0a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381500.098620:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea106ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.098630:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea106ac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.098636:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a1643af1d00) 00010000:00010000:2.0:1787381500.098638:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381500.098641:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea106ac lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.098646:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea106ac lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787381500.098672:0:5792:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f9eb2570 reply state 00000000692524d7 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea106b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381500.098680:0:5792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787381500.098788:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f6bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+37:11533:x1874205047083136:12345-192.168.203.22@tcp:36:rm.0 Request processed in 3963us (4211us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1787381500.098797:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 198 00010000:00010000:0.0:1787381500.099382:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787381500.099391:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea106c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.099399:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a1600 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:0.0:1787381500.099403:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea106c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.099410:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea106c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.099421:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9a1650b8f500) 00010000:00010000:0.0:1787381500.099424:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787381500.099428:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea106c1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.099445:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea106c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.099462:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381500.099464:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381500.099465:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381500.103742:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea106b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.103780:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea106b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.103788:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea106b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.103795:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a0e00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381500.103799:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea106b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.103806:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea106b3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.103823:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a1650b8fb00) 00010000:00010000:1.0:1787381500.103827:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381500.103831:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea106b3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.103836:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea106b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381500.200385:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381500.200553:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047083392 00000100:00100000:0.0:1787381500.200563:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047083392 00000100:00100000:0.0:1787381500.200630:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 199 00000100:00100000:0.0:1787381500.200641:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f6b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+36:11539:x1874205047083392:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:0.0:1787381500.200669:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381500.200688:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8600/0xbdc38ada7ea106c8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9539ea expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.200822:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea106cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.200837:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea106cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.200849:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea106cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.200863:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9c00/0xbdc38ada7ea106d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.200870:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9c00/0xbdc38ada7ea106d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.200877:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9c00/0xbdc38ada7ea106d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787381500.201695:0:5791:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1787381500.201858:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea106dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.201868:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea106dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.201876:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea106dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.201908:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea106cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.201914:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea106cf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.201920:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea106cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.201925:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c9a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787381500.201929:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea106cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.201935:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea106cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.201946:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a1643af1d00) 00010000:00010000:0.0:1787381500.201949:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787381500.201953:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea106cf lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.201980:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea106cf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787381500.202393:0:5791:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d225a315 reply state 000000004c93c03a transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9c00/0xbdc38ada7ea106d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381500.202405:0:5791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787381500.202441:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8600/0xbdc38ada7ea106c8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539ea expref: 39 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.202456:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea106dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539ea expref: 38 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.202463:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a1643af1f00) 00010000:00010000:0.0:1787381500.202466:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787381500.202468:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16460c9e00, rc 0) 00000100:00100000:0.0:1787381500.202545:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f6b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+39:11539:x1874205047083392:12345-192.168.203.22@tcp:101:bash.0 Request processed in 1905us (2170us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1787381500.202553:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 199 00010000:00010000:3.0:1787381500.205404:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9c00/0xbdc38ada7ea106d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381500.205421:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9c00/0xbdc38ada7ea106d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381500.205428:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9c00/0xbdc38ada7ea106d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381500.205435:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c9c00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381500.205439:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9c00/0xbdc38ada7ea106d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381500.205447:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9c00/0xbdc38ada7ea106d6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381500.205484:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a1643af1600) 00010000:00010000:3.0:1787381500.205487:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381500.205492:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9c00/0xbdc38ada7ea106d6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381500.205498:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9c00/0xbdc38ada7ea106d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381500.212718:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381500.212893:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047083520 00000100:00100000:1.0:1787381500.212904:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047083520 00000100:00100000:1.0:1787381500.212977:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 59 00000100:00100000:1.0:1787381500.212988:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f6b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+5:2350:x1874205047083520:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:1.0:1787381500.213040:0:6588:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1787381500.213065:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787381500.213066:0:6588:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb3bd7ee/0xbdc38ada7ea106eb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9539f1 expref: -99 pid: 6588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787381500.213117:0:6588:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787381500.213139:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=358s v=(0 0) 00010000:00010000:1.0:1787381500.213144:0:6588:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787381500.213161:0:6588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb3bd7ee/0xbdc38ada7ea106eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539f1 expref: 6 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.213181:0:6588:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fb3bd7ee/0xbdc38ada7ea106eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539f1 expref: 6 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.213206:0:6588:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541388800, rc 0) 00000100:00100000:1.0:1787381500.213261:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f6b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+6:2350:x1874205047083520:12345-192.168.203.22@tcp:101:bash.0 Request processed in 275us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381500.219906:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 59 00000100:00100000:0.0:1787381500.222428:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381500.222532:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047083648 00000100:00100000:2.0:1787381500.222542:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047083648 00000100:00100000:2.0:1787381500.222600:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 60 00000100:00100000:2.0:1787381500.222610:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fb25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2157c09-10df-40cb-8228-ad4822122c97+6:11539:x1874205047083648:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:2.0:1787381500.222628:0:7779:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381500.222657:0:7779:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be540742/0xbdc38ada7ea106f2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9539f8 expref: -99 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.222689:0:7779:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb3bd7ee/0xbdc38ada7ea106eb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539f1 expref: 7 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.222698:0:7779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787381500.222702:0:7779:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787381500.222709:0:7779:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be540742/0xbdc38ada7ea106f2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539f8 expref: 7 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.222742:0:7779:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb3bd7ee/0xbdc38ada7ea106eb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539f1 expref: 7 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.222774:0:7779:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb3bd7ee/0xbdc38ada7ea106eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539f1 expref: 7 pid: 6588 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381500.222787:0:7779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7779:1874205065947648:192.168.203.22@tcp:104: 00000100:00100000:2.0:1787381500.222883:0:7779:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a164599a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787381500.227910:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381500.228048:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047083776 00000100:00100000:1.0:1787381500.228057:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047083776 00010000:00010000:1.0:1787381500.228095:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb3bd7ee/0xbdc38ada7ea106eb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539f1 expref: 8 pid: 6588 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381500.228125:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 76 00000100:00100000:1.0:1787381500.228134:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+8:2349:x1874205047083776:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787381500.228149:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381500.228182:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb3bd7ee/0xbdc38ada7ea106eb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539f1 expref: 8 pid: 6588 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.228215:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb3bd7ee/0xbdc38ada7ea106eb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539f1 expref: 8 pid: 6588 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.228240:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787381500.228244:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787381500.228252:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000be540742/0xbdc38ada7ea106f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539f8 expref: 8 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.228263:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be540742/0xbdc38ada7ea106f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539f8 expref: 8 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.228299:0:5775:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000be540742/0xbdc38ada7ea106f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539f8 expref: 8 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381500.228313:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1645adc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5775:1874205065947776:192.168.203.22@tcp:105: 00000100:00100000:1.0:1787381500.228395:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f6899c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787381500.229513:0:7779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb3bd7ee/0xbdc38ada7ea106eb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539f1 expref: 8 pid: 6588 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381500.229532:0:7779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7779:1874205065947648:192.168.203.22@tcp:104: 00010000:00010000:0.0:1787381500.229555:0:7779:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000be540742/0xbdc38ada7ea106f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539f8 expref: 7 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.229585:0:7779:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16413a1800, rc 0) 00000100:00100000:0.0:1787381500.229733:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fb25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2157c09-10df-40cb-8228-ad4822122c97+7:11539:x1874205047083648:12345-192.168.203.22@tcp:101:bash.0 Request processed in 7123us (7313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381500.229741:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 60 00000100:00100000:2.0:1787381500.235738:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381500.236069:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047084032 00000100:00100000:3.0:1787381500.236079:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047084032 00000100:00100000:3.0:1787381500.236145:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:3.0:1787381500.236161:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+38:11539:x1874205047084032:12345-192.168.203.22@tcp:35:bash.0 00000100:00100000:3.0:1787381500.236482:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+39:11539:x1874205047084032:12345-192.168.203.22@tcp:35:bash.0 Request processed in 328us (754us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1787381500.236490:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:1.0:1787381500.237645:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1645adc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5775:1874205065947776:192.168.203.22@tcp:105: 00010000:00010000:1.0:1787381500.237672:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381500.237725:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+6:2349:x1874205047083776:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 9591us (9823us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381500.237734:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 76 00000100:00100000:2.0:1787381500.579495:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381500.579594:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047084160 00000100:00100000:1.0:1787381500.579606:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047084160 00000100:00100000:1.0:1787381500.579667:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 200 00000100:00100000:1.0:1787381500.579677:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+39:11555:x1874205047084160:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1787381500.579717:0:11324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381500.579738:0:11324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea106f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a9539ff expref: -99 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.579810:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea10700 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.579825:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea10700 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.579836:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea10700 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787381500.579897:0:11324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1787381500.579901:0:11324:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787381500.579923:0:11324:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea10700 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.579948:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea106f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539ff expref: 41 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.579965:0:11324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea10700 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539ff expref: 40 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.579983:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a1643af1d00) 00010000:00010000:1.0:1787381500.579986:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787381500.579997:0:11324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541389800, rc 0) 00000100:00100000:1.0:1787381500.580115:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+40:11555:x1874205047084160:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 440us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381500.580122:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 200 00000100:00100000:3.0:1787381500.589719:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381500.590869:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047084416 00000100:00100000:2.0:1787381500.590882:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047084416 00000100:00100000:2.0:1787381500.590954:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 201 00000100:00100000:2.0:1787381500.590976:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f6b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+40:11555:x1874205047084416:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1787381500.590998:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381500.591070:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10707 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953a06 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.591207:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1070e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.591222:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1070e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.591235:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1070e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787381500.591246:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787381500.591405:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10707 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a06 expref: 43 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.591426:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1070e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a06 expref: 42 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.591436:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a1643af1f00) 00010000:00010000:2.0:1787381500.591439:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787381500.591443:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16413a1600, rc 0) 00000100:00100000:2.0:1787381500.591520:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f6b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+42:11555:x1874205047084416:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 556us (1809us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1787381500.591528:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 201 00000100:00100000:2.0:1787381500.600168:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381500.600297:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047084672 00000100:00100000:0.0:1787381500.600308:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047084672 00000100:00100000:0.0:1787381500.600371:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 202 00000100:00100000:0.0:1787381500.600382:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+42:11555:x1874205047084672:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1787381500.600406:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381500.600427:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8600/0xbdc38ada7ea1071c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953a0d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.600518:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea10723 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.600531:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea10723 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.600542:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea10723 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787381500.600553:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787381500.600687:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8600/0xbdc38ada7ea1071c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a0d expref: 45 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.600705:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea10723 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a0d expref: 44 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.600732:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a1643af1f00) 00010000:00010000:0.0:1787381500.600735:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787381500.600738:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16460c9a00, rc 0) 00000100:00100000:0.0:1787381500.600803:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+44:11555:x1874205047084672:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 423us (651us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1787381500.600810:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 202 00000100:00100000:3.0:1787381500.605750:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381500.605850:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047084800 00000100:00100000:2.0:1787381500.605860:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047084800 00000100:00100000:2.0:1787381500.605927:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:2.0:1787381500.605937:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f6b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2157c09-10df-40cb-8228-ad4822122c97+44:2350:x1874205047084800:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787381500.605952:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381500.605986:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1070e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a06 expref: 44 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.606044:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a1643af1f00) 00010000:00010000:2.0:1787381500.606050:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787381500.606108:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f6b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2157c09-10df-40cb-8228-ad4822122c97+43:2350:x1874205047084800:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 172us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381500.606116:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:3.0:1787381500.612429:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381500.612951:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047084928 00000100:00100000:0.0:1787381500.612961:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047084928 00000100:00100000:0.0:1787381500.613056:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 61 00000100:00100000:0.0:1787381500.613066:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16461ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2157c09-10df-40cb-8228-ad4822122c97+6:2349:x1874205047084928:12345-192.168.203.22@tcp:1:lfs.0 00010000:00010000:0.0:1787381500.613108:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec1ae6d2/0xbdc38ada7ea10731 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.613140:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000be540742/0xbdc38ada7ea106f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539f8 expref: 6 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.613149:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381500.613161:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787381500.613165:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec1ae6d2/0xbdc38ada7ea10731 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.613200:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000be540742/0xbdc38ada7ea106f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539f8 expref: 6 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.613213:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000be540742/0xbdc38ada7ea106f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539f8 expref: 6 pid: 7779 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381500.613241:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a33d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6590:1874205065947904:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787381500.613330:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16455eaf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787381500.616709:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a33d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6590:1874205065947904:192.168.203.22@tcp:104: 00010000:00010000:0.0:1787381500.616738:0:6590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ec1ae6d2/0xbdc38ada7ea10731 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381500.621469:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381500.621563:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047085056 00000100:00100000:2.0:1787381500.621586:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047085056 00002000:00100000:2.0:1787381500.621632:0:6593:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9a16461ef100 x1874205047085056/t0(0) o4->f2157c09-10df-40cb-8228-ad4822122c97@192.168.203.22@tcp:551/0 lens 504/0 e 0 to 0 dl 1787381511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787381500.621652:0:6593:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a16461ef100 with x1874205047085056 ext(0->8) 00010000:00010000:2.0:1787381500.621660:0:6593:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000be540742/0xbdc38ada7ea106f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539f8 expref: 7 pid: 7779 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.621677:0:6593:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000be540742/0xbdc38ada7ea106f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539f8 expref: 7 pid: 7779 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787381500.621683:0:6593:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a16461ef100 00000100:00100000:2.0:1787381500.621713:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 3 00000100:00100000:2.0:1787381500.621722:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16461ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f2157c09-10df-40cb-8228-ad4822122c97+7:2350:x1874205047085056:12345-192.168.203.22@tcp:4:lfs.0 00000100:00100000:2.0:1787381500.622211:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16461ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f2157c09-10df-40cb-8228-ad4822122c97+9:2350:x1874205047085056:12345-192.168.203.22@tcp:4:lfs.0 Request processed in 488us (750us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787381500.622220:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 3 00002000:00100000:2.0:1787381500.622226:0:6593:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9a16461ef100 x1874205047085056/t4294967308(0) o4->f2157c09-10df-40cb-8228-ad4822122c97@192.168.203.22@tcp:551/0 lens 504/448 e 0 to 0 dl 1787381511 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787381500.622235:0:6593:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a16461ef100 with x1874205047085056 ext(0->8) 00010000:00010000:2.0:1787381500.622241:0:6593:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000be540742/0xbdc38ada7ea106f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539f8 expref: 9 pid: 7779 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.622254:0:6593:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000be540742/0xbdc38ada7ea106f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539f8 expref: 9 pid: 7779 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787381500.622261:0:6593:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a16461ef100 00000100:00100000:3.0:1787381500.638417:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381500.638714:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047085184 00000100:00100000:1.0:1787381500.638724:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047085184 00010000:00010000:1.0:1787381500.638763:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000be540742/0xbdc38ada7ea106f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539f8 expref: 9 pid: 7779 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381500.638806:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 77 00000100:00100000:1.0:1787381500.638815:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16461edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+9:2349:x1874205047085184:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787381500.638832:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787381500.638850:0:5775:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787381500.638852:0:5775:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787381499 00002000:00010000:1.0:1787381500.638854:0:5775:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787381499 00002000:00010000:1.0:1787381500.638856:0:5775:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787381499 00010000:00010000:1.0:1787381500.638862:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000be540742/0xbdc38ada7ea106f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539f8 expref: 9 pid: 7779 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.638875:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000be540742/0xbdc38ada7ea106f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539f8 expref: 9 pid: 7779 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.638897:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be540742/0xbdc38ada7ea106f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539f8 expref: 9 pid: 7779 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.638914:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787381500.638918:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787381500.638923:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ec1ae6d2/0xbdc38ada7ea10731 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.638932:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec1ae6d2/0xbdc38ada7ea10731 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.638981:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381500.639067:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16461edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+8:2349:x1874205047085184:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 253us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381500.639075:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 77 00010000:00010000:0.0:1787381500.639340:0:6590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ec1ae6d2/0xbdc38ada7ea10731 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.639350:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec1ae6d2/0xbdc38ada7ea10731 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.639377:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec1ae6d2/0xbdc38ada7ea10731 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.639384:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec1ae6d2/0xbdc38ada7ea10731 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.639392:0:6590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec1ae6d2/0xbdc38ada7ea10731 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.639398:0:6590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c8600 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:0.0:1787381500.639403:0:6590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec1ae6d2/0xbdc38ada7ea10731 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.639423:0:6590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec1ae6d2/0xbdc38ada7ea10731 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.639437:0:6590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec1ae6d2/0xbdc38ada7ea10731 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.639445:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec1ae6d2/0xbdc38ada7ea10731 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381500.639501:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16461ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2157c09-10df-40cb-8228-ad4822122c97+7:2349:x1874205047084928:12345-192.168.203.22@tcp:1:lfs.0 Request processed in 26436us (27081us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381500.639509:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 61 00000100:00100000:3.0:1787381500.648141:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381500.648236:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047085440 00000100:00100000:2.0:1787381500.648246:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047085440 00000100:00100000:2.0:1787381500.648307:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 56 00000100:00100000:2.0:1787381500.648316:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166d3b9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+43:11555:x1874205047085440:12345-192.168.203.22@tcp:35:lfs.0 00000004:00010000:2.0:1787381500.648380:0:5794:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea10723 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a0d expref: 43 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787381500.648627:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1787381500.648688:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1787381500.648988:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1787381500.649087:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10738 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.649103:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea106dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539ea expref: 47 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.649111:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10738 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.649145:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea106dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539ea expref: 47 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.649160:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea106dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539ea expref: 47 pid: 5791 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381500.649175:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6c8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5794:1874205065948032:192.168.203.22@tcp:104: 00000100:00100000:2.0:1787381500.649270:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a164599a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787381500.653526:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381500.653626:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6c8000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5794:1874205065948032:192.168.203.22@tcp:104: 00010000:00010000:3.0:1787381500.653661:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10738 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381500.653800:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047085568 00000100:00100000:0.0:1787381500.653808:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047085568 00010000:00010000:0.0:1787381500.653841:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea106dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539ea expref: 48 pid: 5791 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381500.653879:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 78 00000100:00100000:0.0:1787381500.653889:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+48:2350:x1874205047085568:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787381500.653903:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787381500.653908:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea106dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539ea expref: 48 pid: 5791 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.653920:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea106dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539ea expref: 48 pid: 5791 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.653953:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea106dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539ea expref: 48 pid: 5791 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.653978:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a1643af1f00) 00010000:00010000:0.0:1787381500.653983:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10738 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.653992:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10738 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.653998:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10738 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.654065:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787381500.654117:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+47:2350:x1874205047085568:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 229us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381500.654136:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 78 00010000:00010000:2.0:1787381500.655927:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10738 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.655955:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10738 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787381500.656136:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1787381500.656562:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1787381500.656679:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6c9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5794:1874205065948160:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787381500.656739:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381500.656809:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a164599a900 going to sleep for 11 seconds 00000100:00100000:0.0:1787381500.657597:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065948160 00000100:00100000:0.0:1787381500.657608:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065948160 00000100:00100000:0.0:1787381500.657666:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787381500.657674:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5794:x1874205065948160:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787381500.657769:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5794:x1874205065948160:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 96us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381500.657776:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787381500.657914:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6c9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5794:1874205065948160:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787381500.658435:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1787381500.658506:0:5794:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6c9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5794:1874205065948288:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787381500.658544:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381500.658567:0:5794:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1647ff6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787381500.658860:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065948288 00000100:00100000:1.0:1787381500.658866:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065948288 00000100:00100000:1.0:1787381500.658894:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787381500.658901:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5794:x1874205065948288:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787381500.659102:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5794:x1874205065948288:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 200us (556us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787381500.659109:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787381500.659491:0:5794:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6c9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5794:1874205065948288:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787381500.659544:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1787381500.659585:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10738 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.659596:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10738 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.659604:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10738 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.659610:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a0e00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381500.659614:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10738 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.659648:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10738 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.659665:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a1643af1f00) 00010000:00010000:2.0:1787381500.659668:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787381500.659673:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10738 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.659679:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea10738 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787381500.659851:0:5794:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787381500.659953:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1787381500.659964:0:5794:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 358790958833ns, next at 359790957185ns, rc = 0 00000001:00080000:2.0:1787381500.659983:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1787381500.660050:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a1643af1f00) 00010000:00010000:2.0:1787381500.660054:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787381500.660061:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9a00/0xbdc38ada7ea10723 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a0d expref: 51 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381500.660643:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166d3b9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+50:11555:x1874205047085440:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 12315us (12509us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1787381500.660655:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 56 00000020:00080000:2.0:1787381500.660660:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787381500.673435:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381500.673481:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047085696 00000100:00100000:3.0:1787381500.673493:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047085696 00000100:00100000:3.0:1787381500.673548:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 203 00000100:00100000:3.0:1787381500.673558:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a802a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+50:11555:x1874205047085696:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1787381500.673581:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381500.673600:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea1073f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953a14 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381500.673965:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea1073f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a14 expref: 51 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381500.673992:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea1073f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a14 expref: 51 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381500.674035:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a1643052600) 00010000:00010000:3.0:1787381500.674039:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787381500.674043:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb0800, rc 0) 00000100:00100000:3.0:1787381500.674107:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a802a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+51:11555:x1874205047085696:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 550us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381500.674116:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 203 00000100:00100000:1.0:1787381500.679528:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381500.679630:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047085952 00000100:00100000:2.0:1787381500.679702:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047085952 00000100:00100000:2.0:1787381500.679797:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 57 00000100:00100000:2.0:1787381500.679807:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+51:11555:x1874205047085952:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:2.0:1787381500.680123:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645adc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+52:11555:x1874205047085952:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 316us (603us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1787381500.680140:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 57 00000100:00100000:1.0:1787381500.769499:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381500.769593:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047086080 00000100:00100000:0.0:1787381500.769603:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047086080 00000100:00100000:0.0:1787381500.769665:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 204 00000100:00100000:0.0:1787381500.769674:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+52:11565:x1874205047086080:12345-192.168.203.22@tcp:34:lfs.0 00010000:00010000:0.0:1787381500.769766:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea10746 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.769796:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea10746 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.769808:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea10746 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.769823:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea1074d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.769830:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea1074d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.769836:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea1074d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.769932:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea10754 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.769941:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea10754 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.769948:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea10754 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787381500.769998:0:8469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea10754 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.770041:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea10746 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.770057:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea10746 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.770064:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea10746 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.770070:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c8e00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787381500.770075:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea10746 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.770082:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea10746 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.770094:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a1643af1d00) 00010000:00010000:0.0:1787381500.770097:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787381500.770100:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea10746 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.770106:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea10746 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.770118:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea1074d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.770124:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea1074d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.770129:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea1074d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.770134:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c8200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787381500.770143:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea1074d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.770149:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea1074d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.770157:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a1643af1b00) 00010000:00010000:0.0:1787381500.770159:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787381500.770161:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea1074d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.770166:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea1074d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.770179:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea10754 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.770185:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea10754 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.770190:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea10754 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.770195:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c8400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787381500.770197:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea10754 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.770202:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea10754 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.770209:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a1643052600) 00010000:00010000:0.0:1787381500.770210:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787381500.770219:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea10754 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381500.770225:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea10754 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381500.770299:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+52:11565:x1874205047086080:12345-192.168.203.22@tcp:34:lfs.0 Request processed in 626us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381500.770307:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 204 00000100:00100000:0.0:1787381500.800083:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381500.800177:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047086336 00000100:00100000:1.0:1787381500.800188:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047086336 00000100:00100000:1.0:1787381500.800259:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 205 00000100:00100000:1.0:1787381500.800269:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a33d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+52:11568:x1874205047086336:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1787381500.800289:0:11324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381500.800308:0:11324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea1075b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953a1b expref: -99 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.800377:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10762 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.800391:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10762 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.800420:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10762 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.800434:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea10769 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.800441:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea10769 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.800447:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea10769 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.800559:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea10770 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.800567:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea10770 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.800574:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea10770 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787381500.800584:0:11324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787381500.800671:0:11324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10762 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.800679:0:11324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10762 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.800686:0:11324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10762 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.800691:0:11324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381500.800700:0:11324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10762 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.800708:0:11324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10762 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.800719:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a1643af1d00) 00010000:00010000:1.0:1787381500.800723:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381500.800726:0:11324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10762 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.800733:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10762 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.803930:0:11324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea10769 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.803941:0:11324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea10769 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.803948:0:11324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea10769 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.803954:0:11324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381500.803959:0:11324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea10769 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.803980:0:11324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea10769 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.803996:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a1659f89a00) 00010000:00010000:1.0:1787381500.803999:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381500.804051:0:11324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea10769 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.804058:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388000/0xbdc38ada7ea10769 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.804121:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389000/0xbdc38ada7ea1075b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a1b expref: 55 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.804136:0:11324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea10770 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a1b expref: 54 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.804144:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a1643052600) 00010000:00010000:1.0:1787381500.804146:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787381500.804149:0:11324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541389e00, rc 0) 00000100:00100000:1.0:1787381500.804231:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a33d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+54:11568:x1874205047086336:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 3950us (4143us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1787381500.804241:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 205 00010000:00010000:2.0:1787381500.812464:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787381500.813976:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381500.814048:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047086464 00000100:00100000:3.0:1787381500.814058:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047086464 00000100:00100000:3.0:1787381500.814116:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 206 00000100:00100000:3.0:1787381500.814238:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+54:11568:x1874205047086464:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:3.0:1787381500.814308:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea1077e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381500.814340:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea1077e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381500.814351:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea1077e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381500.814378:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea1077e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381500.814385:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea1077e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381500.814391:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea1077e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381500.814397:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb1400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381500.814402:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea1077e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381500.814409:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea1077e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381500.814421:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a1643052600) 00010000:00010000:3.0:1787381500.814424:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787381500.814429:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea1077e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381500.814434:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea1077e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381500.814511:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+54:11568:x1874205047086464:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 387us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381500.814525:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 206 00000100:00100000:0.0:1787381500.819844:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381500.819989:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047086720 00000100:00100000:3.0:1787381500.819999:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047086720 00000100:00100000:3.0:1787381500.820097:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 58 00000100:00100000:3.0:1787381500.820107:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a33e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+54:11568:x1874205047086720:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:3.0:1787381500.820358:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a33e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+55:11568:x1874205047086720:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 251us (521us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1787381500.820367:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 58 00000100:00100000:0.0:1787381500.962434:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381500.962544:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047086976 00000100:00100000:3.0:1787381500.962555:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047086976 00000100:00100000:3.0:1787381500.962618:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 207 00000100:00100000:3.0:1787381500.962628:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+55:11578:x1874205047086976:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:3.0:1787381500.962663:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381500.962668:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787381500.962694:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389800/0xbdc38ada7ea10700 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539ff expref: 55 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381500.962715:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a1643af1d00) 00010000:00010000:3.0:1787381500.962719:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787381500.962732:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea10785 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953a22 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381500.962825:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea1078c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381500.963001:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea1078c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381500.963122:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea1078c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787381500.963134:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787381500.963311:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea10785 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a22 expref: 57 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381500.963325:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea1078c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a22 expref: 56 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381500.963333:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a1643052600) 00010000:00010000:3.0:1787381500.963336:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787381500.963338:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb1a00, rc 0) 00000100:00100000:3.0:1787381500.963435:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a805180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+56:11578:x1874205047086976:12345-192.168.203.22@tcp:101:bash.0 Request processed in 807us (1010us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1787381500.963442:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 207 00000100:00100000:1.0:1787381500.973485:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381500.976677:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047087104 00000100:00100000:2.0:1787381500.976692:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047087104 00000100:00100000:2.0:1787381500.976774:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:2.0:1787381500.976784:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645adc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2157c09-10df-40cb-8228-ad4822122c97+56:2349:x1874205047087104:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787381500.976814:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381500.976838:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea1078c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a22 expref: 56 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.976859:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a1643052600) 00010000:00010000:2.0:1787381500.976864:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787381500.976929:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645adc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2157c09-10df-40cb-8228-ad4822122c97+55:2349:x1874205047087104:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 146us (3453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381500.976937:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:0.0:1787381500.982615:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381500.983998:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047087360 00000100:00100000:1.0:1787381500.984048:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047087360 00000100:00100000:1.0:1787381500.984109:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 208 00000100:00100000:1.0:1787381500.984119:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+55:11578:x1874205047087360:12345-192.168.203.22@tcp:36:bash.0 00010000:00010000:1.0:1787381500.984188:0:11324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381500.984215:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389e00/0xbdc38ada7ea10770 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a1b expref: 55 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.984235:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a1643052600) 00010000:00010000:1.0:1787381500.984253:0:11324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787381500.984467:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea1079a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.984480:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea1079a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381500.984490:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea1079a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787381500.984539:0:11324:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:1.0:1787381500.984564:0:11324:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dabaa3b2 reply state 000000008d2f050e transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea1079a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381500.984573:0:11324:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787381500.984678:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a804700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+57:11578:x1874205047087360:12345-192.168.203.22@tcp:36:bash.0 Request processed in 560us (2070us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1787381500.984686:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 208 00000020:00080000:1.0:1787381500.984691:0:11324:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787381500.995243:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381500.995341:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047087488 00000100:00100000:2.0:1787381500.995350:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047087488 00000100:00100000:2.0:1787381500.995409:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 209 00000100:00100000:2.0:1787381500.995419:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+57:11578:x1874205047087488:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:2.0:1787381500.995443:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381500.995460:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea107a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953a29 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.995535:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea107a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.995561:0:5790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea1079a lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.995568:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea107a8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.995584:0:5790:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea1079a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.995596:0:5790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea107a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381500.996235:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea1079a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381500.996333:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea1079a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381500.996340:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea1079a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381500.996346:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381500.996349:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea1079a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381500.996370:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea1079a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381500.996385:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a1643052600) 00010000:00010000:3.0:1787381500.996388:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381500.996391:0:3294:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea107a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381500.996399:0:3294:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea107a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381500.996406:0:3294:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea107a8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381500.996439:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea1079a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381500.996446:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea1079a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.996519:0:5790:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea107a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.996527:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea107a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787381500.996566:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787381500.996571:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787381500.996590:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea107a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.996620:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea107a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a29 expref: 58 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.996636:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea107a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a29 expref: 57 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381500.996644:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a1643052600) 00010000:00010000:2.0:1787381500.996655:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787381500.996658:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16413a1800, rc 0) 00000100:00100000:2.0:1787381500.996724:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+57:11578:x1874205047087488:12345-192.168.203.22@tcp:101:bash.0 Request processed in 1305us (1491us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381500.996733:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 209 00000100:00100000:3.0:1787381501.005601:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381501.006060:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047087744 00000100:00100000:2.0:1787381501.006070:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047087744 00000100:00100000:2.0:1787381501.006144:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 59 00000100:00080000:3.0:1787381501.006568:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787381501.006611:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a801500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+57:11578:x1874205047087744:12345-192.168.203.22@tcp:35:bash.0 00000100:00100000:2.0:1787381501.008191:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a801500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+58:11578:x1874205047087744:12345-192.168.203.22@tcp:35:bash.0 Request processed in 2030us (2591us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1787381501.008204:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 59 00000100:00100000:3.0:1787381501.070427:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381501.070475:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381501.070513:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381501.070547:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047088128 00000100:00100000:3.0:1787381501.070556:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047088128 00000100:00080000:3.0:1787381501.070584:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787381501.070627:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 154 00000100:00100000:3.0:1787381501.070636:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a803800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2349:x1874205047088128:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381501.070728:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a803800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2349:x1874205047088128:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 93us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381501.070737:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 154 00000100:00100000:1.0:1787381501.070923:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047088000 00000100:00100000:1.0:1787381501.070929:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047088000 00000100:00100000:1.0:1787381501.070975:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 76 00000100:00100000:1.0:1787381501.070982:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2157c09-10df-40cb-8228-ad4822122c97+9:2349:x1874205047088000:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787381501.071048:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2157c09-10df-40cb-8228-ad4822122c97+9:2349:x1874205047088000:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 66us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381501.071055:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 76 00000100:00080000:1.0:1787381501.071073:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787381501.071580:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047087872 00000100:00100000:2.0:1787381501.071586:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047087872 00000100:00100000:2.0:1787381501.071623:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 297 00000100:00100000:2.0:1787381501.071630:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2349:x1874205047087872:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787381501.071679:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2349:x1874205047087872:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 49us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381501.071685:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 297 00000100:00100000:3.0:1787381501.159979:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381501.160162:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047088256 00000100:00100000:0.0:1787381501.160171:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047088256 00000100:00100000:0.0:1787381501.160239:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 210 00000100:00100000:0.0:1787381501.160249:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a802d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+58:11584:x1874205047088256:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1787381501.160283:0:8469:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381501.160306:0:8469:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea107af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953a30 expref: -99 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.160370:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea107b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.160383:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea107b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.160394:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea107b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787381501.160456:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787381501.160471:0:8469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787381501.160497:0:8469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea107b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.160521:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea107af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a30 expref: 60 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.160538:0:8469:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea107b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a30 expref: 59 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.160546:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a1643af1d00) 00010000:00010000:0.0:1787381501.160548:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787381501.160552:0:8469:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16460c8800, rc 0) 00000100:00100000:0.0:1787381501.160609:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a802d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+59:11584:x1874205047088256:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 361us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381501.160616:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 210 00000100:00100000:1.0:1787381501.178303:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381501.178454:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047088384 00000100:00100000:2.0:1787381501.178464:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047088384 00000100:00100000:2.0:1787381501.178520:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 211 00000100:00100000:2.0:1787381501.178529:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16750b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+59:11584:x1874205047088384:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1787381501.178549:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381501.178569:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea107bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953a37 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.178660:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea107c4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.178674:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea107c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.178684:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea107c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.178699:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea107cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.178706:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea107cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.178713:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea107cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.178815:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea107d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.178825:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea107d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.178833:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea107d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787381501.178869:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787381501.178873:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787381501.178890:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea107d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.178912:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea107d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.178920:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea107c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.178927:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea107c4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.178934:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea107c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.178940:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a1600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381501.178944:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea107c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.178952:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea107c4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.178974:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a1643af1d00) 00010000:00010000:2.0:1787381501.178977:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381501.178982:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea107c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.178996:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea107c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.179042:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea107cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.179049:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea107cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.179061:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea107cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.179066:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a0a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381501.179069:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea107cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.179076:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea107cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.179085:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a1650b8fa00) 00010000:00010000:2.0:1787381501.179088:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381501.179090:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea107cb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.179096:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea107cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.179127:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea107bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a37 expref: 61 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.179140:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea107d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a37 expref: 60 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.179147:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a1643052600) 00010000:00010000:2.0:1787381501.179149:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787381501.179152:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1681732800, rc 0) 00000100:00100000:2.0:1787381501.179217:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16750b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+60:11584:x1874205047088384:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 688us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381501.179233:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 211 00000100:00100000:3.0:1787381501.195353:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381501.195401:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381501.195556:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047088512 00000100:00100000:1.0:1787381501.195581:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047088512 00000100:00100000:1.0:1787381501.195655:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:1.0:1787381501.195665:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a801880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+60:2349:x1874205047088512:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787381501.195681:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381501.195706:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea107d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a37 expref: 60 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381501.195726:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a1643052600) 00010000:00010000:1.0:1787381501.195731:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381501.195791:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a801880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+59:2349:x1874205047088512:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 126us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381501.195799:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:0.0:1787381501.197660:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047088768 00000100:00100000:0.0:1787381501.197676:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047088768 00000100:00100000:0.0:1787381501.197740:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 212 00000100:00100000:0.0:1787381501.197749:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a803480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+59:11584:x1874205047088768:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1787381501.197769:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381501.197788:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea107d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953a3e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.197896:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8000/0xbdc38ada7ea107e0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.197912:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea107a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a29 expref: 60 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.197938:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8000/0xbdc38ada7ea107e0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.197983:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea107a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953a29 expref: 60 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.197996:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea107a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953a29 expref: 60 pid: 5790 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381501.198482:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a804a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1874205065948416:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787381501.198578:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16455eaf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787381501.202246:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381501.202451:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047088896 00000100:00100000:1.0:1787381501.202460:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047088896 00010000:00010000:1.0:1787381501.202499:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea107a8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953a29 expref: 61 pid: 5790 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381501.202539:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 79 00000100:00100000:1.0:1787381501.202549:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1665874450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+61:2350:x1874205047088896:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787381501.202564:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381501.202571:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea107a8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953a29 expref: 61 pid: 5790 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381501.202583:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea107a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953a29 expref: 61 pid: 5790 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381501.202605:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a1643052600) 00010000:00010000:1.0:1787381501.202623:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8000/0xbdc38ada7ea107e0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381501.202643:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8000/0xbdc38ada7ea107e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381501.202651:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8000/0xbdc38ada7ea107e0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381501.202670:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381501.202716:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1665874450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+61:2350:x1874205047088896:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 168us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381501.202724:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 79 00010000:00010000:0.0:1787381501.203324:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea107a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953a29 expref: 60 pid: 5790 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381501.203343:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a804a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1874205065948416:192.168.203.22@tcp:104: 00010000:00010000:0.0:1787381501.203363:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8000/0xbdc38ada7ea107e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.203371:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8000/0xbdc38ada7ea107e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.203377:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8000/0xbdc38ada7ea107e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787381501.203396:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787381501.203536:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea107d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a3e expref: 61 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.203565:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8000/0xbdc38ada7ea107e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a3e expref: 60 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.203572:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a1643052600) 00010000:00010000:0.0:1787381501.203575:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787381501.203578:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16460c8000, rc 0) 00000100:00100000:0.0:1787381501.203611:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a803480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+60:11584:x1874205047088768:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 5863us (8209us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1787381501.203618:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 212 00000100:00100000:3.0:1787381501.210245:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381501.210523:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047089152 00000100:00100000:2.0:1787381501.210534:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047089152 00000100:00100000:2.0:1787381501.210591:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:2.0:1787381501.210601:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a802300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2157c09-10df-40cb-8228-ad4822122c97+60:11584:x1874205047089152:12345-192.168.203.22@tcp:103:lfs.0 00010000:00010000:2.0:1787381501.210617:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381501.210653:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea1073f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a14 expref: 60 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.210672:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a1643052600) 00010000:00010000:2.0:1787381501.210677:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787381501.210734:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a802300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2157c09-10df-40cb-8228-ad4822122c97+59:11584:x1874205047089152:12345-192.168.203.22@tcp:103:lfs.0 Request processed in 134us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381501.210742:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:3.0:1787381501.214533:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381501.214696:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047089280 00000100:00100000:2.0:1787381501.214706:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047089280 00000100:00100000:2.0:1787381501.214762:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 213 00000100:00100000:2.0:1787381501.214773:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a801880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+59:11584:x1874205047089280:12345-192.168.203.22@tcp:58:lfs.0 00010000:00010000:2.0:1787381501.214896:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea107ee lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.214912:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea107ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.214924:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea107ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787381501.215331:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1787381501.215426:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a801880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+59:11584:x1874205047089280:12345-192.168.203.22@tcp:58:lfs.0 Request processed in 653us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381501.215436:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 213 00000100:00100000:3.0:1787381501.219618:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381501.219837:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047089408 00000100:00100000:1.0:1787381501.219847:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047089408 00000100:00100000:1.0:1787381501.219908:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 214 00000100:00100000:1.0:1787381501.219917:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1644e1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+59:11584:x1874205047089408:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1787381501.219938:0:11324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381501.219957:0:11324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea107f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953a45 expref: -99 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381501.220329:0:11324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea107ee lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381501.220342:0:11324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea107f5 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a45 expref: 60 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381501.220362:0:11324:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea107ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381501.220394:0:11324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea107f5 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a45 expref: 60 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381501.220408:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a1643052600) 00010000:00010000:1.0:1787381501.220411:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787381501.220415:0:11324:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea107f5 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a45 expref: 60 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381501.220423:0:11324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541388600, rc 0) 00000100:00100000:1.0:1787381501.220493:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1644e1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+60:11584:x1874205047089408:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 577us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381501.220501:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 214 00000001:00080000:3.0:1787381501.335079:0:7481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1787381501.335101:0:7481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000040:00080000:3.0:1787381501.335346:0:11528:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787381501.335352:0:11528:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787381501.335386:0:11528:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1787381501.335393:0:11528:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787381501.335506:0:11528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1644e1df80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11528:1874205065948544:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787381501.335603:0:11528:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1660b399c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787381501.341373:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381501.341463:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047089536 00000100:00100000:0.0:1787381501.341472:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047089536 00000100:00100000:0.0:1787381501.342249:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 215 00000100:00100000:0.0:1787381501.342263:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a528e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+61:11585:x1874205047089536:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787381501.342294:0:5791:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787381501.342387:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a528e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+61:11585:x1874205047089536:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 128us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381501.342395:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 215 00000100:00100000:2.0:1787381501.342473:0:11528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1644e1df80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11528:1874205065948544:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787381501.347277:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381501.347309:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047089664 00000100:00100000:3.0:1787381501.347318:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047089664 00000100:00100000:3.0:1787381501.347377:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 216 00000100:00100000:3.0:1787381501.347386:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+60:11585:x1874205047089664:12345-192.168.203.22@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787381501.347457:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea107fc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.347488:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea107fc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.347499:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea107fc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.347513:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea10803 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.347519:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea10803 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.347525:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea10803 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.347554:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea1080a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.347561:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea1080a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.347567:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea1080a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787381501.347601:0:8469:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787381501.347605:0:8469:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787381501.347615:0:8469:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea1080a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.347624:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea107fc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.347648:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea107fc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.347655:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea107fc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.347661:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb1400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381501.347665:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea107fc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.347672:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea107fc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.347682:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a1643052000) 00010000:00010000:3.0:1787381501.347685:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381501.347689:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea107fc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.347695:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea107fc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.347707:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea10803 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.347713:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea10803 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.347718:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea10803 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.347723:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb0600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381501.347729:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea10803 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.347736:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea10803 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.347742:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9a1643052d00) 00010000:00010000:3.0:1787381501.347745:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381501.347747:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea10803 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.347752:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea10803 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.347765:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea1080a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.347770:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea1080a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.347775:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea1080a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.347780:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb0800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381501.347782:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea1080a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.347788:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea1080a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.347794:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a1643052600) 00010000:00010000:3.0:1787381501.347796:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381501.347803:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea1080a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.347809:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea1080a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381501.347867:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a529f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+60:11585:x1874205047089664:12345-192.168.203.22@tcp:34:lhsmtool_posix.0 Request processed in 481us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381501.347874:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 216 00000100:00100000:1.0:1787381501.357249:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381501.357525:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047089920 00000100:00100000:2.0:1787381501.357535:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047089920 00000100:00100000:2.0:1787381501.357595:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 217 00000100:00100000:2.0:1787381501.357605:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f6b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+60:11585:x1874205047089920:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787381501.357625:0:11324:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381501.357646:0:11324:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea10811 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953a4c expref: -99 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.357741:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10818 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.357757:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10818 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.357768:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10818 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787381501.357780:0:11324:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787381501.357879:0:11324:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10818 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.357887:0:11324:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10818 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.357912:0:11324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10818 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.357918:0:11324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681732800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381501.357922:0:11324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10818 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.357930:0:11324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10818 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.357943:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a1643052600) 00010000:00010000:2.0:1787381501.357947:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787381501.357951:0:11324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10818 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.357957:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10818 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.358027:0:11324:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea10811 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a4c expref: 62 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.358038:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a1643052000) 00010000:00010000:2.0:1787381501.358040:0:11324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787381501.358044:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea10811 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a4c expref: 62 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.358053:0:11324:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1681732000, rc 0) 00000100:00100000:2.0:1787381501.358287:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f6b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+61:11585:x1874205047089920:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 682us (1046us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1787381501.358305:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 217 00000100:00100000:0.0:1787381501.362520:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381501.362648:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047090048 00000100:00100000:3.0:1787381501.362658:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047090048 00000100:00100000:3.0:1787381501.362745:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 218 00000100:00100000:3.0:1787381501.362755:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+61:11585:x1874205047090048:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787381501.362793:0:5791:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787381501.362894:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a804a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+61:11585:x1874205047090048:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 140us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381501.362902:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 218 00000100:00100000:0.0:1787381501.371770:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381501.371999:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047090304 00000100:00100000:3.0:1787381501.372025:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047090304 00000100:00100000:3.0:1787381501.372082:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 219 00000100:00100000:3.0:1787381501.372103:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+61:11585:x1874205047090304:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787381501.372229:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381501.372234:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787381501.372261:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8800/0xbdc38ada7ea107b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a30 expref: 61 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.372280:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a1643af1d00) 00010000:00010000:3.0:1787381501.372284:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787381501.372312:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea10826 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953a53 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787381501.372829:0:5790:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:3.0:1787381501.374317:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea1082d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.374336:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea1082d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.374347:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea1082d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.374418:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea10826 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a53 expref: 63 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.374437:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea1082d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a53 expref: 62 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.374446:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a1643052d00) 00010000:00010000:3.0:1787381501.374448:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787381501.374451:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb0600, rc 0) 00000100:00100000:3.0:1787381501.374514:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a807480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+62:11585:x1874205047090304:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 2423us (2753us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1787381501.374523:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 219 00000100:00100000:1.0:1787381501.385726:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381501.386240:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047090560 00000100:00100000:2.0:1787381501.386251:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047090560 00000100:00100000:2.0:1787381501.386310:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 220 00000100:00100000:2.0:1787381501.386320:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16461edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+62:11585:x1874205047090560:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787381501.386384:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381501.386411:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea1082d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a53 expref: 62 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.386695:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a1643052d00) 00010000:00010000:2.0:1787381501.386706:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787381501.386726:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea1083b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.386739:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea1083b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.386749:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea1083b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.386764:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10842 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x4005fa04 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.386771:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10842 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x4005fa04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.386779:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10842 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x4005fa04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.386865:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea1083b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.386873:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea1083b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.386880:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea1083b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.386886:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681732000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381501.386890:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea1083b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.386898:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea1083b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.386907:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a1643af1d00) 00010000:00010000:2.0:1787381501.386911:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381501.386915:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea1083b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.386921:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea1083b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.386930:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10842 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x4005fa04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.386936:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10842 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4005fa04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.386942:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10842 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4005fa04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.386953:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681732800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381501.386956:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10842 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4005fa04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.386974:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10842 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x4005fa04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.386983:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x4005fa04 (ffff9a1650b8fa00) 00010000:00010000:2.0:1787381501.386985:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381501.386987:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10842 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x4005fa04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.386993:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea10842 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x4005fa04 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381501.388331:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16461edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+61:11585:x1874205047090560:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 2005us (2606us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787381501.388344:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 220 00000100:00100000:0.0:1787381501.390395:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381501.390479:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047090688 00000100:00100000:3.0:1787381501.390488:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047090688 00000100:00100000:3.0:1787381501.390540:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 221 00000100:00100000:3.0:1787381501.390549:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+61:11585:x1874205047090688:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787381501.390582:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381501.390603:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea10849 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953a5a expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.390638:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea10850 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.390651:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea10850 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.390662:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea10850 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.390746:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea10849 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a5a expref: 63 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.390763:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea10850 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a5a expref: 62 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.390771:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a1643052300) 00010000:00010000:3.0:1787381501.390773:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787381501.390776:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb1400, rc 0) 00000100:00100000:3.0:1787381501.390828:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a804000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+62:11585:x1874205047090688:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 280us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381501.390835:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 221 00000100:00100000:1.0:1787381501.400863:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381501.407237:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047090944 00000100:00100000:3.0:1787381501.407253:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047090944 00000100:00100000:2.0:1787381501.407627:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 222 00000100:00100000:2.0:1787381501.407639:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+62:11585:x1874205047090944:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787381501.407718:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea10857 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.407735:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea10857 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.407747:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea10857 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787381501.408723:0:5790:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1787381501.408739:0:5790:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 359539733867ns, next at 360539729287ns, rc = 0 00000004:00010000:0.0:1787381501.408841:0:5790:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008fd15c01 reply state 000000009bcb62f4 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea10857 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381501.408868:0:5790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787381501.408979:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+64:11585:x1874205047090944:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 1340us (8121us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1787381501.408988:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 222 00010000:00010000:2.0:1787381501.412365:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea10857 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.412384:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea10857 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.412392:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea10857 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.412399:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681732000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381501.412404:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea10857 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.412412:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea10857 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.412441:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a1643052300) 00010000:00010000:2.0:1787381501.412445:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787381501.412449:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea10857 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.412456:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732000/0xbdc38ada7ea10857 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381501.415989:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381501.416109:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047091072 00000100:00100000:2.0:1787381501.416244:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047091072 00000100:00100000:2.0:1787381501.416310:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 223 00000100:00100000:2.0:1787381501.416320:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+63:11585:x1874205047091072:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787381501.416345:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381501.416378:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea1085e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953a61 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.417285:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea1085e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a61 expref: 64 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.417306:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea1085e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a61 expref: 64 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.417328:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a1643052300) 00010000:00010000:2.0:1787381501.417331:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787381501.417334:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1681732800, rc 0) 00000100:00100000:2.0:1787381501.417397:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+64:11585:x1874205047091072:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 1078us (1416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381501.417405:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 223 00000100:00100000:3.0:1787381501.429535:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381501.429648:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047091200 00000100:00100000:1.0:1787381501.429657:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047091200 00000100:00100000:1.0:1787381501.429713:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 62 00000100:00100000:1.0:1787381501.429722:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a528a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+9:2349:x1874205047091200:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787381501.430032:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a528a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+10:2349:x1874205047091200:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 Request processed in 310us (505us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1787381501.430041:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 62 00000100:00100000:3.0:1787381501.445334:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381501.445491:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047091456 00000100:00100000:1.0:1787381501.445501:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047091456 00000100:00100000:1.0:1787381501.445563:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 60 00000100:00100000:1.0:1787381501.445572:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a52b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+64:11585:x1874205047091456:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787381501.445801:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a52b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+65:11585:x1874205047091456:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 228us (475us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1787381501.445809:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 60 00000100:00100000:3.0:1787381501.457413:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381501.457517:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047091712 00000100:00100000:0.0:1787381501.457526:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047091712 00000100:00100000:0.0:1787381501.457581:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 224 00000100:00100000:0.0:1787381501.457591:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+65:11585:x1874205047091712:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787381501.457716:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+65:11585:x1874205047091712:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 125us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381501.457724:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 224 00000100:00100000:3.0:1787381501.478835:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381501.479072:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047091840 00000100:00100000:0.0:1787381501.479083:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047091840 00000100:00100000:0.0:1787381501.479144:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 225 00000100:00100000:0.0:1787381501.479154:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a52a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+65:11585:x1874205047091840:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787381501.479173:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381501.479195:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8c00/0xbdc38ada7ea10865 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953a68 expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.479285:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea1086c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.479300:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea1086c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.479312:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea1086c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787381501.479356:0:5790:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787381501.479371:0:5790:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea1086c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.479401:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8c00/0xbdc38ada7ea10865 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a68 expref: 67 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.479419:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea1086c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a68 expref: 66 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.479428:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a1643052300) 00010000:00010000:0.0:1787381501.479431:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787381501.479434:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16460c9600, rc 0) 00000100:00100000:0.0:1787381501.479498:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a52a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+66:11585:x1874205047091840:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 345us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381501.479505:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 225 00000100:00100000:1.0:1787381501.501991:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381501.502334:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047091968 00000100:00100000:0.0:1787381501.502344:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047091968 00000100:00100000:0.0:1787381501.502404:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 63 00000100:00100000:0.0:1787381501.502415:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2157c09-10df-40cb-8228-ad4822122c97+10:2349:x1874205047091968:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787381501.502431:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381501.502452:0:6587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e0f01f8/0xbdc38ada7ea10873 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953a6f expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787381501.502478:0:6587:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8946fc, blocks: 0x1 00010000:00010000:0.0:1787381501.502500:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=359s v=(0 0) 00010000:00010000:0.0:1787381501.502518:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381501.502526:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e0f01f8/0xbdc38ada7ea10873 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a6f expref: 11 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.502545:0:6587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006e0f01f8/0xbdc38ada7ea10873 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a6f expref: 11 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.502558:0:6587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16460c8c00, rc 0) 00000100:00100000:0.0:1787381501.502618:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2157c09-10df-40cb-8228-ad4822122c97+11:2349:x1874205047091968:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 204us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381501.502625:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 63 00000100:00100000:3.0:1787381501.510250:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381501.510405:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047092224 00000100:00100000:2.0:1787381501.510415:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047092224 00000100:00100000:2.0:1787381501.510476:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 226 00000100:00100000:2.0:1787381501.510485:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542863100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+66:11585:x1874205047092224:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787381501.510592:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542863100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+66:11585:x1874205047092224:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 107us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381501.510600:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 226 00000100:00100000:3.0:1787381501.520995:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381501.521213:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047092352 00000100:00100000:0.0:1787381501.521223:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047092352 00000100:00100000:0.0:1787381501.521280:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 64 00000100:00100000:0.0:1787381501.521290:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542861c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2157c09-10df-40cb-8228-ad4822122c97+11:11585:x1874205047092352:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787381501.521306:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381501.521324:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000989795e2/0xbdc38ada7ea1087a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953a76 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.521355:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006e0f01f8/0xbdc38ada7ea10873 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a6f expref: 12 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.521364:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381501.521369:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381501.521374:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000989795e2/0xbdc38ada7ea1087a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a76 expref: 12 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.521426:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006e0f01f8/0xbdc38ada7ea10873 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953a6f expref: 12 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.521439:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006e0f01f8/0xbdc38ada7ea10873 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953a6f expref: 12 pid: 6587 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381501.521454:0:6590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a5c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6590:1874205065948672:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787381501.521540:0:6590:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16455ea180 going to sleep for 11 seconds 00000100:00100000:2.0:1787381501.530158:0:6590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a5c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6590:1874205065948672:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787381501.530197:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000989795e2/0xbdc38ada7ea1087a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a76 expref: 12 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.530221:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16460c9200, rc 0) 00000100:00100000:2.0:1787381501.530293:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542861c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2157c09-10df-40cb-8228-ad4822122c97+12:11585:x1874205047092352:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 9004us (9306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381501.530303:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 64 00000100:00100000:3.0:1787381501.537890:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381501.538083:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047092480 00000100:00100000:1.0:1787381501.538102:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047092480 00010000:00010000:1.0:1787381501.538149:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006e0f01f8/0xbdc38ada7ea10873 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953a6f expref: 12 pid: 6587 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381501.538190:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 80 00000100:00100000:1.0:1787381501.538199:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645b71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+12:2349:x1874205047092480:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787381501.538214:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381501.538238:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006e0f01f8/0xbdc38ada7ea10873 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953a6f expref: 12 pid: 6587 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381501.538251:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006e0f01f8/0xbdc38ada7ea10873 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953a6f expref: 12 pid: 6587 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381501.538273:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e0f01f8/0xbdc38ada7ea10873 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953a6f expref: 12 pid: 6587 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381501.538290:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787381501.538294:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787381501.538312:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000989795e2/0xbdc38ada7ea1087a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a76 expref: 11 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381501.538322:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000989795e2/0xbdc38ada7ea1087a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a76 expref: 11 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381501.538355:0:5775:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000989795e2/0xbdc38ada7ea1087a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a76 expref: 11 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381501.538367:0:5775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5775:1874205065948800:192.168.203.22@tcp:105: 00000100:00100000:1.0:1787381501.538440:0:5775:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f689a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787381501.542427:0:5775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5775:1874205065948800:192.168.203.22@tcp:105: 00010000:00010000:1.0:1787381501.542453:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381501.542510:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645b71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+11:2349:x1874205047092480:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 4311us (4627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381501.542522:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 80 00000100:00100000:3.0:1787381501.547804:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381501.547936:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047092608 00000100:00100000:2.0:1787381501.547946:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047092608 00002000:00100000:2.0:1787381501.548029:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9a1645b73100 x1874205047092608/t0(0) o4->f2157c09-10df-40cb-8228-ad4822122c97@192.168.203.22@tcp:552/0 lens 504/0 e 0 to 0 dl 1787381512 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787381501.548041:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a1645b73100 with x1874205047092608 ext(0->12) 00002000:00010000:2.0:1787381501.548046:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a1645b73100 00000100:00100000:2.0:1787381501.548082:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:2.0:1787381501.548090:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645b73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f2157c09-10df-40cb-8228-ad4822122c97+11:2350:x1874205047092608:12345-192.168.203.22@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787381501.548550:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645b73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f2157c09-10df-40cb-8228-ad4822122c97+13:2350:x1874205047092608:12345-192.168.203.22@tcp:4:lhsmtool_posix.0 Request processed in 460us (754us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1787381501.548559:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 6 00002000:00100000:2.0:1787381501.548565:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9a1645b73100 x1874205047092608/t4294967320(0) o4->f2157c09-10df-40cb-8228-ad4822122c97@192.168.203.22@tcp:552/0 lens 504/448 e 0 to 0 dl 1787381512 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787381501.548574:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a1645b73100 with x1874205047092608 ext(0->12) 00002000:00010000:2.0:1787381501.548578:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a1645b73100 00000100:00100000:3.0:1787381501.552107:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381501.552284:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047092736 00000100:00100000:0.0:1787381501.552294:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047092736 00000100:00100000:0.0:1787381501.552353:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 227 00000100:00100000:0.0:1787381501.552363:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+66:11585:x1874205047092736:12345-192.168.203.22@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1787381501.703999:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+66:11585:x1874205047092736:12345-192.168.203.22@tcp:44:lhsmtool_posix.0 Request processed in 151627us (151889us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381501.704070:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 227 00000001:00080000:0.0:1787381501.704107:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967502 is committed 00000001:00080000:0.0:1787381501.706361:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:0.0:1787381501.706397:0:5813:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:0.0:1787381501.706432:0:5813:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1787381501.706453:0:5813:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a164599a900 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1787381501.706458:0:5813:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9a167503cb00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a164599a000 00000020:00080000:0.0:1787381501.706462:0:5813:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9a167503c300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a167ffb1800 00000004:00080000:0.0:1787381501.706485:0:5813:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:0.0:1787381501.706544:0:5813:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a167a3726c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1787381501.706547:0:5813:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9a167f4d8f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a167a372e40 00000020:00080000:0.0:1787381501.706550:0:5813:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9a167f4d8b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a167fe07400 00000100:00100000:3.0:1787381501.707410:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000020:00080000:0.0:1787381501.707574:0:5825:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:2.0:1787381501.707883:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047092864 00000100:00100000:2.0:1787381501.707891:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047092864 00000100:00100000:2.0:1787381501.707936:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 65 00000100:00100000:2.0:1787381501.707945:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645b73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2157c09-10df-40cb-8228-ad4822122c97+13:2349:x1874205047092864:12345-192.168.203.22@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787381501.708028:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787381501.708042:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a5c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065948928:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787381501.708103:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381501.708218:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065949184:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787381501.708242:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381501.708261:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787381501.708266:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065949056:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787381501.708286:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381501.708306:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065948928 00000100:00100000:2.0:1787381501.708309:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065948928 00000100:00100000:2.0:1787381501.708337:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065949184 00000100:00100000:2.0:1787381501.708340:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065949184 00000100:00100000:2.0:1787381501.708351:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065949056 00000100:00100000:2.0:1787381501.708353:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065949056 00000100:00100000:2.0:1787381501.708364:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787381501.708371:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065948928:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787381501.708386:0:6587:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:2.0:1787381501.708415:0:6587:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8946fb, atime: 0x6a8946fb, ctime: 0x6a8946fb, blocks: 0xb 00010000:00010000:2.0:1787381501.708423:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f7fd3bb/0xbdc38ada7ea10881 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.708439:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=359s v=(0 0) 00010000:00010000:2.0:1787381501.708443:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787381501.708448:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f7fd3bb/0xbdc38ada7ea10881 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.708465:0:6587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f7fd3bb/0xbdc38ada7ea10881 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.708475:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f7fd3bb/0xbdc38ada7ea10881 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.708489:0:6587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f7fd3bb/0xbdc38ada7ea10881 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.708508:0:6587:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:0.0:1787381501.708867:0:5825:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1787381501.709912:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1874205065948928:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1537us (1804us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787381501.709923:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787381501.709949:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787381501.709957:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3309:x1874205065949184:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1787381501.710107:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787381501.710115:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f7fd3bb/0xbdc38ada7ea10881 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381501.710134:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681732000 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:1.0:1787381501.710138:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f7fd3bb/0xbdc38ada7ea10881 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381501.710149:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f7fd3bb/0xbdc38ada7ea10881 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381501.710182:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f7fd3bb/0xbdc38ada7ea10881 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381501.710189:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f7fd3bb/0xbdc38ada7ea10881 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381501.710209:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381501.710211:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381501.710212:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787381501.710222:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787381501.710226:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787381501.710994:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1787381501.711026:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a16600c7480, transno 4294967307 00000004:00080000:0.0:1787381501.711042:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:0.0:1787381501.711068:0:3310:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9a167a5c8e00 x1874205065948928/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787381517 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1787381501.711081:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a167a5c8e00/2, rc 0, transno 4294967310 00000100:00100000:0.0:1787381501.711086:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a5c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065948928:0@lo:6:osp-syn-1-0.0 00002000:00010000:2.0:1787381501.713766:0:6587:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787381501.713775:0:6587:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787381500 00002000:00010000:2.0:1787381501.713778:0:6587:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787381501.713780:0:6587:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787381500 -> 1787381500 00002000:00010000:2.0:1787381501.713781:0:6587:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787381501.713859:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3309:x1874205065949184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3900us (5611us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1787381501.713870:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787381501.713898:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787381501.713909:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3309:x1874205065949056:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787381501.713932:0:6587:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:2.0:1787381501.713950:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be540742/0xbdc38ada7ea10888 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.713980:0:6587:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000304ef184/0xbdc38ada7ea10643 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539d5 expref: 13 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.714028:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787381501.714033:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787381501.714038:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be540742/0xbdc38ada7ea10888 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.714073:0:6587:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000304ef184/0xbdc38ada7ea10643 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539d5 expref: 13 pid: 7779 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.714088:0:6587:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000304ef184/0xbdc38ada7ea10643 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539d5 expref: 13 pid: 7779 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381501.714104:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6c9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6587:1874205065949312:192.168.203.22@tcp:104: 00000100:00100000:2.0:1787381501.714184:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1647ff6480 going to sleep for 11 seconds 00000004:00080000:2.0:1787381501.714311:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a167a6c8e00/2, rc 0, transno 4294967321 00000100:00100000:2.0:1787381501.714318:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065949184:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787381501.727721:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381501.727995:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047092992 00000100:00100000:3.0:1787381501.728028:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047092992 00010000:00010000:3.0:1787381501.728065:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000304ef184/0xbdc38ada7ea10643 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539d5 expref: 14 pid: 7779 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381501.728102:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 81 00000100:00100000:3.0:1787381501.728112:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+14:2349:x1874205047092992:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787381501.728131:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787381501.728137:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000304ef184/0xbdc38ada7ea10643 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539d5 expref: 14 pid: 7779 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.728151:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000304ef184/0xbdc38ada7ea10643 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539d5 expref: 14 pid: 7779 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.728176:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787381501.728181:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787381501.728186:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000be540742/0xbdc38ada7ea10888 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.728209:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be540742/0xbdc38ada7ea10888 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.728231:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787381501.728278:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+14:2349:x1874205047092992:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 167us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381501.728286:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 81 00010000:00010000:2.0:1787381501.729749:0:6587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000304ef184/0xbdc38ada7ea10643 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.22@tcp remote: 0xc01952459a9539d5 expref: 13 pid: 7779 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381501.729771:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6c9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6587:1874205065949312:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787381501.729793:0:6587:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000be540742/0xbdc38ada7ea10888 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.729804:0:6587:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000be540742/0xbdc38ada7ea10888 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.729823:0:6587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be540742/0xbdc38ada7ea10888 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.729833:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be540742/0xbdc38ada7ea10888 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.729841:0:6587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be540742/0xbdc38ada7ea10888 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.729858:0:6587:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787381501.730401:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3309:x1874205065949056:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16493us (22111us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1787381501.730412:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:2.0:1787381501.730441:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787381501.730447:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be540742/0xbdc38ada7ea10888 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.730455:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a1800 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:2.0:1787381501.730460:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be540742/0xbdc38ada7ea10888 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.730469:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be540742/0xbdc38ada7ea10888 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.730488:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be540742/0xbdc38ada7ea10888 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.730505:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be540742/0xbdc38ada7ea10888 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.730527:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381501.730528:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381501.730530:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787381501.730558:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a167a6c8380/2, rc 0, transno 4294967322 00000100:00100000:2.0:1787381501.730564:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065949056:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787381501.768360:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645b73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2157c09-10df-40cb-8228-ad4822122c97+12:2349:x1874205047092864:12345-192.168.203.22@tcp:16:lhsmtool_posix.0 Request processed in 60403us (60942us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381501.768375:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 65 00000001:00080000:3.0:1787381501.768494:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:3.0:1787381501.768507:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:3.0:1787381501.768519:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000100:00100000:1.0:1787381501.771203:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381501.771293:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047093248 00000100:00100000:2.0:1787381501.771303:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047093248 00000100:00100000:2.0:1787381501.771361:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 228 00000100:00100000:2.0:1787381501.771371:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+20:11585:x1874205047093248:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787381501.771421:0:11324:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381501.771448:0:11324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9600/0xbdc38ada7ea1086c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a68 expref: 20 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.771467:0:11324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a1643052300) 00010000:00010000:2.0:1787381501.771472:0:11324:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787381501.771501:0:11324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea1088f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.771515:0:11324:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea1088f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.771536:0:11324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea1088f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787381501.771785:0:11324:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c16232f1 reply state 000000005bb9e66b transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea1088f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381501.771795:0:11324:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787381501.771886:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+21:11585:x1874205047093248:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 515us (699us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1787381501.771894:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 228 00010000:00010000:3.0:1787381501.774071:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea1088f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.774087:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea1088f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.774094:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea1088f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.774101:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a1800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381501.774105:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea1088f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.774121:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea1088f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.774137:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a1643052300) 00010000:00010000:3.0:1787381501.774140:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381501.774157:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea1088f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.774165:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1800/0xbdc38ada7ea1088f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11324 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381501.775754:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381501.775827:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047093376 00000100:00100000:3.0:1787381501.775838:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047093376 00000100:00100000:3.0:1787381501.775895:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 69 00000100:00100000:3.0:1787381501.775905:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2157c09-10df-40cb-8228-ad4822122c97+7:2350:x1874205047093376:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787381501.776141:0:6590:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787381501.776145:0:6590:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1787381500 -> 1787381499 00002000:00010000:3.0:1787381501.776147:0:6590:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787381499 00002000:00010000:3.0:1787381501.776150:0:6590:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787381500 -> 1787381499 00002000:00010000:3.0:1787381501.776152:0:6590:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1787381501.776214:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2157c09-10df-40cb-8228-ad4822122c97+8:2350:x1874205047093376:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 Request processed in 310us (467us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1787381501.776222:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 69 00000100:00100000:2.0:1787381501.780614:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381501.780701:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047093632 00000100:00100000:0.0:1787381501.780711:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047093632 00000100:00100000:0.0:1787381501.780767:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 229 00000100:00100000:0.0:1787381501.780776:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+20:11585:x1874205047093632:12345-192.168.203.22@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787381501.780845:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea10896 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.780862:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea10850 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a5a expref: 20 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.780870:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea10896 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.780901:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea10850 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953a5a expref: 20 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.780936:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea10850 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953a5a expref: 20 pid: 5791 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381501.780951:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f5c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1874205065949440:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787381501.781065:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16455ea180 going to sleep for 11 seconds 00000100:00100000:0.0:1787381501.784349:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f5c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1874205065949440:192.168.203.22@tcp:104: 00010000:00010000:0.0:1787381501.784380:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea10896 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381501.786343:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381501.786855:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047093760 00000100:00100000:1.0:1787381501.786864:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047093760 00010000:00010000:1.0:1787381501.786901:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea10850 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953a5a expref: 21 pid: 5791 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381501.786943:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 82 00000100:00100000:1.0:1787381501.786951:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1644e1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+21:2350:x1874205047093760:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787381501.786975:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381501.786983:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea10850 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953a5a expref: 21 pid: 5791 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381501.786996:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea10850 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953a5a expref: 21 pid: 5791 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381501.787072:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea10850 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953a5a expref: 21 pid: 5791 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381501.787088:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a1643052300) 00010000:00010000:1.0:1787381501.787095:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea10896 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381501.787105:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea10896 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381501.787112:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea10896 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381501.787154:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787381501.787348:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea10896 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.787356:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea10896 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.787384:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea10896 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.787392:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea10896 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.787398:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea10896 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.787404:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c8e00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787381501.787408:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea10896 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.787426:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea10896 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.787436:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a1643052300) 00010000:00010000:0.0:1787381501.787439:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787381501.787443:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea10896 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.787449:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8e00/0xbdc38ada7ea10896 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381501.787508:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+20:11585:x1874205047093632:12345-192.168.203.22@tcp:55:lhsmtool_posix.0 Request processed in 6732us (6903us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787381501.787517:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 229 00000100:00100000:1.0:1787381501.788335:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1644e1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+19:2350:x1874205047093760:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 1381us (1997us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381501.788346:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 82 00000100:00100000:2.0:1787381501.791420:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381501.791495:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047093888 00000100:00100000:0.0:1787381501.791504:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047093888 00000100:00100000:0.0:1787381501.791555:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 70 00000100:00100000:0.0:1787381501.791564:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674fd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2157c09-10df-40cb-8228-ad4822122c97+8:2349:x1874205047093888:12345-192.168.203.22@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787381501.791606:0:6587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003e368c36/0xbdc38ada7ea1089d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.791638:0:6587:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000989795e2/0xbdc38ada7ea1087a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a76 expref: 8 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.791648:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381501.791653:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787381501.791657:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e368c36/0xbdc38ada7ea1089d lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.791706:0:6587:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000989795e2/0xbdc38ada7ea1087a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.22@tcp remote: 0xc01952459a953a76 expref: 8 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.791720:0:6587:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000989795e2/0xbdc38ada7ea1087a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a953a76 expref: 8 pid: 6590 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381501.791734:0:6587:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f5c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6587:1874205065949568:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787381501.791819:0:6587:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16455ea180 going to sleep for 11 seconds 00000100:00100000:0.0:1787381501.795373:0:6587:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f5c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6587:1874205065949568:192.168.203.22@tcp:104: 00010000:00010000:0.0:1787381501.795405:0:6587:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003e368c36/0xbdc38ada7ea1089d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381501.796721:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381501.796813:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047094016 00000100:00100000:1.0:1787381501.796822:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047094016 00010000:00010000:1.0:1787381501.796858:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000989795e2/0xbdc38ada7ea1087a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a953a76 expref: 9 pid: 6590 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381501.796899:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 83 00000100:00100000:1.0:1787381501.796908:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f923800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2157c09-10df-40cb-8228-ad4822122c97+9:2349:x1874205047094016:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787381501.796922:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381501.796944:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000989795e2/0xbdc38ada7ea1087a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a953a76 expref: 9 pid: 6590 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381501.796989:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000989795e2/0xbdc38ada7ea1087a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a953a76 expref: 9 pid: 6590 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381501.797086:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000989795e2/0xbdc38ada7ea1087a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.22@tcp remote: 0xc01952459a953a76 expref: 9 pid: 6590 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381501.797104:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787381501.797109:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787381501.797114:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003e368c36/0xbdc38ada7ea1089d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381501.797128:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e368c36/0xbdc38ada7ea1089d lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381501.797198:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381501.797256:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f923800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2157c09-10df-40cb-8228-ad4822122c97+8:2349:x1874205047094016:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 348us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381501.797264:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 83 00010000:00010000:0.0:1787381501.797689:0:6587:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003e368c36/0xbdc38ada7ea1089d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.797700:0:6587:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e368c36/0xbdc38ada7ea1089d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.797726:0:6587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003e368c36/0xbdc38ada7ea1089d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.797735:0:6587:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e368c36/0xbdc38ada7ea1089d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.797756:0:6587:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e368c36/0xbdc38ada7ea1089d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.797764:0:6587:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c8200 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:0.0:1787381501.797768:0:6587:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e368c36/0xbdc38ada7ea1089d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.797778:0:6587:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e368c36/0xbdc38ada7ea1089d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.798410:0:6587:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e368c36/0xbdc38ada7ea1089d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.798421:0:6587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e368c36/0xbdc38ada7ea1089d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381501.798599:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674fd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2157c09-10df-40cb-8228-ad4822122c97+7:2349:x1874205047093888:12345-192.168.203.22@tcp:1:lhsmtool_posix.0 Request processed in 7033us (7186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381501.798609:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 70 00000100:00100000:2.0:1787381501.802487:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381501.802559:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047094272 00000100:00100000:0.0:1787381501.802568:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047094272 00000100:00100000:0.0:1787381501.802636:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 230 00000100:00100000:0.0:1787381501.802647:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+19:11585:x1874205047094272:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787381501.802725:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea108a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.802742:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea108a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.802772:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea108a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.802981:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea108ab lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.802993:0:8469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea1085e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a61 expref: 20 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.803040:0:8469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea108ab lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.803076:0:8469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea1085e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953a61 expref: 20 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.803090:0:8469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea1085e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953a61 expref: 20 pid: 5792 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381501.803104:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f5c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1874205065949696:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787381501.803194:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16455ea180 going to sleep for 11 seconds 00000100:00100000:0.0:1787381501.806185:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f5c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1874205065949696:192.168.203.22@tcp:104: 00010000:00010000:0.0:1787381501.806216:0:8469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea108ab lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381501.807744:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381501.807818:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047094400 00000100:00100000:1.0:1787381501.807828:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047094400 00010000:00010000:1.0:1787381501.807863:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea1085e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953a61 expref: 21 pid: 5792 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381501.807921:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 84 00000100:00100000:1.0:1787381501.807930:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f921500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+21:2350:x1874205047094400:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787381501.807945:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381501.807951:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea1085e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953a61 expref: 21 pid: 5792 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381501.807974:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea1085e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953a61 expref: 21 pid: 5792 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381501.807995:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732800/0xbdc38ada7ea1085e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953a61 expref: 21 pid: 5792 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381501.808040:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a1643052300) 00010000:00010000:1.0:1787381501.808046:0:5775:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea108ab lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381501.808055:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea108ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381501.808062:0:5775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea108ab lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381501.808088:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381501.808143:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f921500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f2157c09-10df-40cb-8228-ad4822122c97+20:2350:x1874205047094400:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 214us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381501.808151:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 84 00010000:00010000:0.0:1787381501.808340:0:8469:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea108ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381501.808348:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea108ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787381501.808524:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1787381501.808688:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1787381501.808730:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1787381501.808808:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f5c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1874205065949824:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787381501.808869:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381501.808940:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16455eab40 going to sleep for 11 seconds 00000100:00100000:1.0:1787381501.814578:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065949824 00000100:00100000:1.0:1787381501.814609:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065949824 00000100:00100000:1.0:1787381501.814713:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787381501.814723:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167ab41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:8469:x1874205065949824:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787381501.814842:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167ab41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:8469:x1874205065949824:12345-0@lo:1000:mdt00_003.0 Request processed in 120us (5972us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381501.814849:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787381501.814997:0:8469:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:3.0:1787381501.815019:0:8469:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:3.0:1787381501.815044:0:8469:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff9a167a6c8e00 x1874205065949184/t4294967321(4294967321) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787381517 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787381501.815057:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f5c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1874205065949824:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1787381501.815536:0:8469:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1787381501.815613:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1645b72a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1874205065949952:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787381501.815671:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381501.815985:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1647eb6300 going to sleep for 11 seconds 00000100:00100000:0.0:1787381501.816081:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065949952 00000100:00100000:0.0:1787381501.816088:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065949952 00000100:00100000:0.0:1787381501.816201:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787381501.816211:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:8469:x1874205065949952:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787381501.816388:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:8469:x1874205065949952:12345-0@lo:1000:mdt00_003.0 Request processed in 178us (716us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1787381501.816397:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787381501.816470:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1645b72a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8469:1874205065949952:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1787381501.816503:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea108ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.816522:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea108ab lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.816530:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea108ab lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.816536:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c9e00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381501.816540:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea108ab lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.816548:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea108ab lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.816563:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a1643052300) 00010000:00010000:3.0:1787381501.816567:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787381501.816571:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea108ab lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.816579:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea108ab lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.816609:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea107ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.816616:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea107ee lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.816622:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea107ee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.817106:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681733000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381501.817110:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea107ee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.817116:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea107ee lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.817195:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a1643052600) 00010000:00010000:3.0:1787381501.817198:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787381501.817206:0:8469:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea107f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a45 expref: 23 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.817217:0:8469:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea107f5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a45 expref: 23 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.817227:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea107f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a45 expref: 23 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.817259:0:8469:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea107f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a45 expref: 23 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381501.817271:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1645b70a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1874205065950080:192.168.203.22@tcp:105: 00000100:00100000:3.0:1787381501.817395:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1647eb6300 going to sleep for 11 seconds 00000100:00100000:2.0:1787381501.821991:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381501.822282:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1645b70a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8469:1874205065950080:192.168.203.22@tcp:105: 00010000:00010000:3.0:1787381501.822310:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea107ee lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.822339:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733000/0xbdc38ada7ea107ee lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.822370:0:8469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea108b2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.822383:0:8469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea108b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.822394:0:8469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea108b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.822404:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea108b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.822411:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea108b2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.822417:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea108b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.822422:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb1a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381501.822426:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea108b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.822434:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea108b2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.822445:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a1643052600) 00010000:00010000:3.0:1787381501.822448:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381501.822452:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea108b2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.822464:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea108b2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.822475:0:8469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea108a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.822481:0:8469:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea108a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.822487:0:8469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea108a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.822492:0:8469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c8400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381501.822495:0:8469:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea108a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.822501:0:8469:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea108a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.822509:0:8469:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a1643052600) 00010000:00010000:3.0:1787381501.822511:0:8469:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787381501.822514:0:8469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea108a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.822520:0:8469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8400/0xbdc38ada7ea108a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8469 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381501.822872:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+23:11585:x1874205047094272:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 20224us (20391us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1787381501.822882:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 230 00000020:00080000:3.0:1787381501.822896:0:8469:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1787381501.823141:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047094528 00000100:00100000:1.0:1787381501.823149:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047094528 00000100:00100000:1.0:1787381501.823232:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 61 00000100:00100000:1.0:1787381501.823242:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fb25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+23:11584:x1874205047094528:12345-192.168.203.22@tcp:49:lfs.0 00000100:00100000:1.0:1787381501.823373:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fb25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+23:11584:x1874205047094528:12345-192.168.203.22@tcp:49:lfs.0 Request processed in 133us (1392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381501.823381:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 61 00000040:00080000:0.0:1787381501.823805:0:11528:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787381501.823810:0:11528:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787381501.824373:0:11528:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787381501.824381:0:11528:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787381501.829430:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381501.829908:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381501.829995:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047094784 00000100:00100000:1.0:1787381501.830023:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047094784 00000100:00100000:1.0:1787381501.830075:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 231 00000100:00100000:1.0:1787381501.830085:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167ab43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+23:11584:x1874205047094784:12345-192.168.203.22@tcp:58:lfs.0 00000100:00100000:3.0:1787381501.830738:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047095040 00000100:00100000:3.0:1787381501.830744:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047095040 00000100:00100000:3.0:1787381501.830784:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 62 00000100:00100000:3.0:1787381501.830792:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166d3b8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+24:11585:x1874205047095040:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000040:00080000:1.0:1787381501.831458:0:5792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1787381501.831870:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167ab43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+25:11584:x1874205047094784:12345-192.168.203.22@tcp:58:lfs.0 Request processed in 1783us (2445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381501.831881:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 231 00010000:00010000:1.0:1787381501.836603:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787381501.836938:0:5794:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787381501.837091:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1787381501.837500:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea108b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.837518:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea108b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.837528:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea108b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.837536:0:5794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea108b9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.837543:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea108b9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.837549:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea108b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.837570:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787381501.837802:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166d3b8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+25:11585:x1874205047095040:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 7006us (7890us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1787381501.837812:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 62 00000020:00080000:3.0:1787381501.837818:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787381501.840296:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787381501.840309:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea108b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.840321:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb1a00 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:2.0:1787381501.840326:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea108b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.840336:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea108b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.840354:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9a1643052300) 00010000:00010000:2.0:1787381501.840371:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787381501.840375:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea108b9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.840382:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1a00/0xbdc38ada7ea108b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.840403:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381501.840405:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381501.840407:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787381501.876548:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381501.876699:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047095168 00000100:00100000:3.0:1787381501.876721:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047095168 00000100:00100000:3.0:1787381501.876774:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 232 00000100:00100000:3.0:1787381501.876783:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1644e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+25:11587:x1874205047095168:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1787381501.876805:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381501.876824:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea108c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953a7d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.876883:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea108c7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.876895:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea108c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.876908:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea108c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.876922:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea108ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.876929:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea108ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.876935:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea108ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.877276:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea108d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.877287:0:5791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8000/0xbdc38ada7ea107e0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a3e expref: 26 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.877295:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea108d5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.877330:0:5791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8000/0xbdc38ada7ea107e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953a3e expref: 26 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.877343:0:5791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8000/0xbdc38ada7ea107e0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953a3e expref: 26 pid: 5791 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381501.877355:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1645b70a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1874205065950208:192.168.203.22@tcp:104: 00000100:00100000:3.0:1787381501.877438:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1647eb6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787381501.883574:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381501.883671:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047095424 00000100:00100000:2.0:1787381501.883681:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047095424 00000100:00100000:2.0:1787381501.883740:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 63 00000100:00100000:2.0:1787381501.883751:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+27:5564:x1874205047095424:12345-192.168.203.22@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787381501.884001:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+28:5564:x1874205047095424:12345-192.168.203.22@tcp:35:ldlm_bl.0 Request processed in 252us (437us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1787381501.884027:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 63 00000100:00100000:3.0:1787381501.887279:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1645b70a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5791:1874205065950208:192.168.203.22@tcp:104: 00010000:00010000:3.0:1787381501.887312:0:5791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea108d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381501.887781:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381501.888026:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047095552 00000100:00100000:3.0:1787381501.888035:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047095552 00010000:00010000:3.0:1787381501.888068:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8000/0xbdc38ada7ea107e0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953a3e expref: 28 pid: 5791 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381501.888105:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 85 00000100:00100000:3.0:1787381501.888123:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1665877850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+28:2349:x1874205047095552:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787381501.888138:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787381501.888144:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8000/0xbdc38ada7ea107e0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953a3e expref: 28 pid: 5791 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.888156:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8000/0xbdc38ada7ea107e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953a3e expref: 28 pid: 5791 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.888336:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8000/0xbdc38ada7ea107e0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953a3e expref: 28 pid: 5791 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.888353:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a1643052600) 00010000:00010000:3.0:1787381501.888358:0:5777:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea108d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.888367:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea108d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.888374:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea108d5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381501.888404:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787381501.888461:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1665877850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f2157c09-10df-40cb-8228-ad4822122c97+27:2349:x1874205047095552:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 347us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381501.888468:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 85 00010000:00010000:2.0:1787381501.889296:0:5791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea108d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.889332:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea108d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787381501.889378:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787381501.889382:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787381501.889401:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea108d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.889414:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea108d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.889439:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea108c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.889446:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea108c7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.889453:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea108c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.889459:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb1200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381501.889463:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea108c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.889470:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea108c7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.889494:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a1643af1d00) 00010000:00010000:2.0:1787381501.889496:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381501.889500:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea108c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.889506:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea108c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.889518:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea108ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.889524:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea108ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.889530:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea108ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.889541:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb1800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381501.889544:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea108ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.889551:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea108ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.889558:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9a1643052200) 00010000:00010000:2.0:1787381501.889561:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381501.889564:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea108ce lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.889570:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1800/0xbdc38ada7ea108ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.889606:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea108c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a7d expref: 27 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.889618:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea108d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a7d expref: 26 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381501.889625:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a1643052600) 00010000:00010000:2.0:1787381501.889627:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787381501.889745:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb0200, rc 0) 00000100:00100000:2.0:1787381501.889802:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1644e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+26:11587:x1874205047095168:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 13018us (13262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381501.889810:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 232 00000040:00080000:3.0:1787381502.866602:0:11528:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787381502.866611:0:11528:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787381502.866648:0:11528:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787381502.866654:0:11528:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787381502.866771:0:11528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1645b71880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11528:1874205065950336:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787381502.866870:0:11528:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1642b906c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787381502.871057:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787381502.879770:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381502.879783:0:11528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1645b71880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11528:1874205065950336:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787381502.880130:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047095680 00000100:00100000:2.0:1787381502.880150:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047095680 00000100:00100000:2.0:1787381502.880211:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 233 00000100:00100000:2.0:1787381502.880222:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1644e1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+26:11599:x1874205047095680:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787381502.880261:0:8469:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787381502.880408:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1644e1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+26:11599:x1874205047095680:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 187us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381502.880416:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 233 00000100:00100000:0.0:1787381502.884467:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381502.884619:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047095936 00000100:00100000:2.0:1787381502.884629:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047095936 00000100:00100000:2.0:1787381502.884690:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 234 00000100:00100000:2.0:1787381502.884700:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1644e1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+26:11599:x1874205047095936:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787381502.884721:0:5792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381502.884783:0:5792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea108dc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953a84 expref: -99 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381502.884891:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1400/0xbdc38ada7ea108e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381502.884905:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1400/0xbdc38ada7ea108e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381502.884918:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1400/0xbdc38ada7ea108e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787381502.884929:0:5792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787381502.885160:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0e00/0xbdc38ada7ea108dc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a84 expref: 29 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381502.885179:0:5792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1400/0xbdc38ada7ea108e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a84 expref: 28 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381502.885195:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a1643052600) 00010000:00010000:2.0:1787381502.885199:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787381502.885203:0:5792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16413a1400, rc 0) 00000100:00100000:2.0:1787381502.885257:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1644e1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+28:11599:x1874205047095936:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 559us (799us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1787381502.885265:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 234 00000100:00100000:3.0:1787381502.895449:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381502.895593:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381502.895697:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047096064 00000100:00100000:3.0:1787381502.895714:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047096064 00000100:00100000:3.0:1787381502.895774:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:3.0:1787381502.895785:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645b71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2157c09-10df-40cb-8228-ad4822122c97+28:2351:x1874205047096064:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787381502.895800:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787381502.895824:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1400/0xbdc38ada7ea108e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a84 expref: 28 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381502.895842:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a1643052600) 00010000:00010000:3.0:1787381502.895847:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787381502.895898:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645b71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f2157c09-10df-40cb-8228-ad4822122c97+27:2351:x1874205047096064:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 116us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381502.895906:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:3.0:1787381502.895929:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047096320 00000100:00100000:3.0:1787381502.895933:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047096320 00000100:00100000:3.0:1787381502.897724:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 235 00000100:00100000:3.0:1787381502.897743:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+27:11599:x1874205047096320:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787381502.897824:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea108f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381502.897841:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea108f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381502.897854:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea108f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381502.899071:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea108f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381502.899085:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea108f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381502.899101:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea108f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381502.899108:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb0800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381502.899113:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea108f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381502.899599:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea108f1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381502.899617:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a1643052600) 00010000:00010000:3.0:1787381502.899693:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787381502.899699:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea108f1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381502.899707:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0800/0xbdc38ada7ea108f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381502.899894:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f2157c09-10df-40cb-8228-ad4822122c97+28:11599:x1874205047096320:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 2153us (4366us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1787381502.899905:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 235 00000040:00080000:3.0:1787381502.900150:0:11528:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787381502.900155:0:11528:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787381502.901742:0:11528:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787381502.901759:0:11528:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787381502.907583:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381502.907746:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047096576 00000100:00100000:1.0:1787381502.907756:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047096576 00000100:00100000:1.0:1787381502.907820:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 64 00000100:00100000:1.0:1787381502.907831:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+28:11599:x1874205047096576:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787381502.909845:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+29:11599:x1874205047096576:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 2008us (2262us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1787381502.909859:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 64 00000040:00080000:2.0:1787381502.916961:0:12407:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787381502.916972:0:12407:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787381502.917272:0:12407:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787381502.917278:0:12407:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787381503.167651:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381503.167769:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047096832 00000100:00100000:0.0:1787381503.167779:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047096832 00000100:00100000:0.0:1787381503.167852:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 236 00000100:00100000:0.0:1787381503.167861:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645b73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+29:11612:x1874205047096832:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1787381503.167898:0:5790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381503.167919:0:5790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea108f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953a8b expref: -99 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381503.168064:0:5790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8600/0xbdc38ada7ea108ff lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381503.168078:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8600/0xbdc38ada7ea108ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381503.168100:0:5790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8600/0xbdc38ada7ea108ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5790 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787381503.168213:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1787381503.168771:0:5790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787381503.169145:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8a00/0xbdc38ada7ea108f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a8b expref: 32 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381503.169176:0:5790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8600/0xbdc38ada7ea108ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a8b expref: 31 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381503.169185:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a1643052600) 00010000:00010000:1.0:1787381503.169187:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787381503.169191:0:5790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16460c8600, rc 0) 00000100:00100000:1.0:1787381503.169261:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645b73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f2157c09-10df-40cb-8228-ad4822122c97+31:11612:x1874205047096832:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 1400us (1617us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1787381503.169270:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 236 00000100:00100000:3.0:1787381503.173749:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381503.173835:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047096960 00000100:00100000:2.0:1787381503.173844:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047096960 00000100:00100000:2.0:1787381503.173892:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 237 00000100:00100000:2.0:1787381503.173900:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+31:11612:x1874205047096960:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:2.0:1787381503.173971:0:5792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1090d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381503.173987:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1090d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381503.173997:0:5792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1090d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381503.174064:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1090d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381503.174073:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1090d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381503.174097:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1090d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381503.174102:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a1600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381503.174107:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1090d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381503.174400:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1090d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381503.174413:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a1643052600) 00010000:00010000:2.0:1787381503.174416:0:5792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787381503.174420:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1090d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381503.174427:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a1600/0xbdc38ada7ea1090d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381503.174571:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+31:11612:x1874205047096960:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 597us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381503.174580:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 237 00000100:00100000:3.0:1787381503.292741:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381503.292828:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047097088 00000100:00100000:2.0:1787381503.292838:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047097088 00000100:00100000:2.0:1787381503.292906:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 71 00000100:00100000:2.0:1787381503.292917:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2157c09-10df-40cb-8228-ad4822122c97+7:2350:x1874205047097088:12345-192.168.203.22@tcp:101:cat.0 00010000:00010000:2.0:1787381503.292935:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381503.292965:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a99c7a2e/0xbdc38ada7ea10914 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953a92 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787381503.293039:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a8946fb, atime: 0x6a8946fb, ctime: 0x6a8946fb, blocks: 0xb 00010000:00010000:2.0:1787381503.293059:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=361s v=(0 0) 00010000:00010000:2.0:1787381503.293063:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787381503.293073:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a99c7a2e/0xbdc38ada7ea10914 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a92 expref: 8 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381503.293092:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a99c7a2e/0xbdc38ada7ea10914 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a92 expref: 8 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381503.293106:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16413a1600, rc 0) 00000100:00100000:2.0:1787381503.293160:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f921500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f2157c09-10df-40cb-8228-ad4822122c97+8:2350:x1874205047097088:12345-192.168.203.22@tcp:101:cat.0 Request processed in 245us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381503.293167:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 71 00000100:00080000:1.0:1787381503.293449:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787381503.299231:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381503.299364:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047097216 00000100:00100000:3.0:1787381503.299386:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047097216 00002000:00100000:3.0:1787381503.299438:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9a167a5c9f80 x1874205047097216/t0(0) o3->f2157c09-10df-40cb-8228-ad4822122c97@192.168.203.22@tcp:554/0 lens 488/0 e 0 to 0 dl 1787381514 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787381503.299449:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a167a5c9f80 with x1874205047097216 ext(0->4095) 00002000:00010000:3.0:1787381503.299455:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a167a5c9f80 00000100:00100000:3.0:1787381503.299488:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:3.0:1787381503.299497:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f2157c09-10df-40cb-8228-ad4822122c97+8:2351:x1874205047097216:12345-192.168.203.22@tcp:3:cat.0 00000100:00100000:3.0:1787381503.299690:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f2157c09-10df-40cb-8228-ad4822122c97+8:2351:x1874205047097216:12345-192.168.203.22@tcp:3:cat.0 Request processed in 193us (467us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787381503.299698:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 7 00002000:00100000:3.0:1787381503.299704:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9a167a5c9f80 x1874205047097216/t0(0) o3->f2157c09-10df-40cb-8228-ad4822122c97@192.168.203.22@tcp:554/0 lens 488/4536 e 0 to 0 dl 1787381514 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787381503.299712:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a167a5c9f80 with x1874205047097216 ext(0->4095) 00002000:00010000:3.0:1787381503.299716:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a167a5c9f80 00010000:00010000:2.0:1787381503.884746:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787381504.332420:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065950464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787381504.332490:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381504.332808:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065950464 00000100:00100000:1.0:1787381504.332817:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065950464 00000100:00100000:1.0:1787381504.332890:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787381504.332900:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16750b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3310:x1874205065950464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787381504.332934:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787381504.332988:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16750b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3310:x1874205065950464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381504.332995:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1787381504.333084:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787381504.333159:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065950464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787381504.333466:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166fb25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1874205065950848:0@lo:400:kworker.0 00000100:00100000:2.0:1787381504.333500:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381504.333527:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787381504.333533:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166fb24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874205065950720:0@lo:400:kworker.0 00000100:00100000:2.0:1787381504.333554:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381504.333580:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065950848 00000100:00100000:2.0:1787381504.333584:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065950848 00000100:00100000:2.0:1787381504.333616:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065950720 00000100:00100000:2.0:1787381504.333620:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065950720 00000100:00100000:3.0:1787381504.333727:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787381504.333736:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645ad8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874205065950848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787381504.333779:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645ad8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874205065950848:12345-0@lo:400:kworker.0 Request processed in 45us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381504.333784:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787381504.333803:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166fb27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd19486c-5291-4823-bb9c-f3a73416a496:3311:1874205065950592:0@lo:400:kworker.0 00000100:00100000:3.0:1787381504.333832:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381504.333855:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16600c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065951104:0@lo:400:kworker.0 00000100:00100000:3.0:1787381504.333876:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381504.333902:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787381504.333907:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16600c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1874205065950976:0@lo:400:kworker.0 00000100:00100000:3.0:1787381504.333927:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381504.333959:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065950592 00000100:00100000:3.0:1787381504.333963:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065950592 00000100:00100000:3.0:1787381504.333983:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1787381504.333989:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+19:3311:x1874205065950592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787381504.334042:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+19:3311:x1874205065950592:12345-0@lo:400:kworker.0 Request processed in 52us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381504.334047:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00080000:3.0:1787381504.334069:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787381504.334086:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166fb25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1874205065950848:0@lo:400:kworker.0 00000100:00100000:3.0:1787381504.334107:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166fb27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd19486c-5291-4823-bb9c-f3a73416a496:3311:1874205065950592:0@lo:400:kworker.0 00000100:00100000:3.0:1787381504.334134:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065950976 00000100:00100000:3.0:1787381504.334138:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065950976 00000100:00100000:3.0:1787381504.334162:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787381504.334167:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f5c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874205065950976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787381504.334359:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f5c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874205065950976:12345-0@lo:400:kworker.0 Request processed in 191us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381504.334365:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:3.0:1787381504.334382:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787381504.334397:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16600c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1874205065950976:0@lo:400:kworker.0 00000100:00100000:3.0:1787381504.334426:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065951104 00000100:00100000:3.0:1787381504.334429:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065951104 00000100:00100000:3.0:1787381504.334454:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787381504.334460:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a33e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1874205065951104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787381504.334498:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a33e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1874205065951104:12345-0@lo:400:kworker.0 Request processed in 39us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381504.334504:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1787381504.334516:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787381504.334531:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16600c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065951104:0@lo:400:kworker.0 00000100:00100000:2.0:1787381504.335369:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787381504.335382:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645ad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874205065950720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381504.335494:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645ad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874205065950720:12345-0@lo:400:kworker.0 Request processed in 116us (1939us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381504.335502:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787381504.344830:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166fb24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874205065950720:0@lo:400:kworker.0 00000100:00100000:1.0:1787381504.844233:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1645adb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065951232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787381504.844302:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381504.844725:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065951232 00000100:00100000:2.0:1787381504.844733:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065951232 00000100:00100000:2.0:1787381504.844779:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787381504.844793:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1874205065951232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787381504.844824:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787381504.844864:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1874205065951232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381504.844871:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787381504.846514:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1645adb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065951232:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787381504.910168:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787381504.972277:0:11528:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787381504.972288:0:11528:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787381504.972332:0:11528:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787381504.972339:0:11528:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787381505.932365:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787381506.193603:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381506.193834:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381506.193942:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047097472 00000100:00100000:0.0:1787381506.193953:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047097472 00000100:00100000:0.0:1787381506.194034:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 158 00000100:00100000:0.0:1787381506.194044:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645adad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+31:2352:x1874205047097472:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787381506.194122:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645adad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+31:2352:x1874205047097472:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 80us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381506.194131:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 158 00000100:00080000:0.0:1787381506.194180:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787381506.195590:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381506.195617:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381506.195677:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047097344 00000100:00100000:0.0:1787381506.195684:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047097344 00000100:00100000:0.0:1787381506.195724:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 299 00000100:00100000:0.0:1787381506.195732:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2352:x1874205047097344:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787381506.195797:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2352:x1874205047097344:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 66us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381506.195804:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 299 00000100:00100000:2.0:1787381506.205849:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381506.205889:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047097856 00000100:00100000:2.0:1787381506.205898:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047097856 00000100:00100000:2.0:1787381506.205966:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 159 00000100:00100000:2.0:1787381506.205976:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2352:x1874205047097856:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787381506.206072:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2352:x1874205047097856:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 98us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381506.206080:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 159 00000100:00080000:2.0:1787381506.206114:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787381506.211537:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047097728 00000100:00100000:1.0:1787381506.211552:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047097728 00000100:00100000:1.0:1787381506.212650:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047097600 00000100:00100000:1.0:1787381506.212658:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047097600 00000100:00100000:0.0:1787381506.212734:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 78 00000100:00100000:0.0:1787381506.212756:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645adb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+5:2352:x1874205047097728:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787381506.212836:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645adb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f2157c09-10df-40cb-8228-ad4822122c97+5:2352:x1874205047097728:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 93us (19001us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381506.212843:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 78 00000100:00080000:2.0:1787381506.218611:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787381506.219942:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787381506.220197:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 79 00000100:00100000:1.0:1787381506.220211:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2157c09-10df-40cb-8228-ad4822122c97+8:2352:x1874205047097600:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787381506.220299:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2157c09-10df-40cb-8228-ad4822122c97+8:2352:x1874205047097600:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 93us (24680us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381506.220308:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 79 00000001:00080000:2.0:1787381506.452239:0:7481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:3.0:1787381506.958171:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:3.0:1787381506.958196:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00010000:00010000:0.0:1787381506.958938:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787381506.967445:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967511 is committed 00000020:00080000:1.0:1787381506.967479:0:5813:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:1.0:1787381506.967504:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1787381506.967569:0:5813:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a1660b399c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1787381506.967575:0:5813:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9a167f4d8400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a1660b39840 00000020:00080000:1.0:1787381506.967580:0:5813:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9a167f4d8100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a167f578c00 00000020:00080000:1.0:1787381506.967603:0:5825:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1787381506.967862:0:5825:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:0.0:1787381507.983928:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381509.005466:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787381509.006304:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381509.006577:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047097984 00000100:00100000:3.0:1787381509.006587:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047097984 00000100:00100000:3.0:1787381509.006730:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 238 00000100:00100000:3.0:1787381509.006741:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+18:11265:x1874205047097984:12345-192.168.203.22@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787381509.006837:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+18:11265:x1874205047097984:12345-192.168.203.22@tcp:60:lhsmtool_posix.0 Request processed in 98us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381509.006845:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 238 00000100:00080000:1.0:1787381509.007029:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787381509.023271:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381509.023418:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047098240 00000100:00100000:1.0:1787381509.023427:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047098240 00000100:00100000:1.0:1787381509.023492:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 65 00000100:00100000:1.0:1787381509.023502:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+18:11265:x1874205047098240:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787381509.023985:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+19:11265:x1874205047098240:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 483us (722us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1787381509.024030:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 65 00000100:00100000:3.0:1787381509.395113:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381509.395202:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047098368 00000100:00100000:0.0:1787381509.395212:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047098368 00000100:00100000:0.0:1787381509.395301:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 239 00000100:00100000:0.0:1787381509.395313:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:12063:x1874205047098368:12345-192.168.203.22@tcp:101:lsof.0 00010000:00010000:0.0:1787381509.395331:0:5791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381509.395351:0:5791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea1091b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953a99 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381509.395412:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea10922 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381509.395453:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea10922 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381509.395463:0:5791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea10922 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787381509.395715:0:5791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787381509.395720:0:5791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787381509.395802:0:5791:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea10922 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381509.395826:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9e00/0xbdc38ada7ea1091b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a99 expref: 7 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381509.395843:0:5791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea10922 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a99 expref: 6 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381509.395852:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1650b8f100) 00010000:00010000:0.0:1787381509.395854:0:5791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787381509.395858:0:5791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16460c8200, rc 0) 00000100:00100000:0.0:1787381509.395927:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+6:12063:x1874205047098368:12345-192.168.203.22@tcp:101:lsof.0 Request processed in 616us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381509.395935:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 239 00000100:00080000:1.0:1787381509.396411:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787381509.452349:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065951360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787381509.452457:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381509.452850:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065951360 00000100:00100000:2.0:1787381509.452859:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065951360 00000100:00100000:2.0:1787381509.452932:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787381509.452944:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065951360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787381509.452978:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787381509.453047:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065951360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381509.453055:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787381509.453093:0:3309:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1787381509.453099:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a167a6c8e00, transno 4294967321 00000004:00080000:2.0:1787381509.453109:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a167a6c8380, transno 4294967322 00000004:00080000:2.0:1787381509.453113:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1787381509.453140:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065951360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787381509.453386:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1645add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd19486c-5291-4823-bb9c-f3a73416a496:3310:1874205065951488:0@lo:400:kworker.0 00000100:00100000:0.0:1787381509.453421:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381509.453476:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a800380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065952000:0@lo:400:kworker.0 00000100:00100000:0.0:1787381509.453504:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381509.453525:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787381509.453531:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1645add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874205065951616:0@lo:400:kworker.0 00000100:00100000:0.0:1787381509.453556:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381509.453583:0:6588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065952000 00000100:00100000:0.0:1787381509.453587:0:6588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065952000 00000100:00100000:0.0:1787381509.453747:0:6588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787381509.453756:0:6588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16461ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065952000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381509.453796:0:6588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16461ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065952000:12345-0@lo:400:kworker.0 Request processed in 42us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381509.453803:0:6588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787381509.453830:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1787381509.453835:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a167a5c8e00, transno 4294967310 00000100:00100000:0.0:1787381509.453843:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a800380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065952000:0@lo:400:kworker.0 00000100:00100000:0.0:1787381509.453878:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a801500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1874205065951872:0@lo:400:kworker.0 00000100:00100000:0.0:1787381509.453900:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381509.453928:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787381509.453934:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a802300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1874205065951744:0@lo:400:kworker.0 00000100:00100000:0.0:1787381509.453956:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381509.453988:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065951616 00000100:00100000:0.0:1787381509.453993:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065951616 00000100:00100000:0.0:1787381509.454035:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065951872 00000100:00100000:0.0:1787381509.454038:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065951872 00000100:00100000:0.0:1787381509.454058:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065951744 00000100:00100000:0.0:1787381509.454061:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065951744 00000100:00100000:0.0:1787381509.454075:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787381509.454081:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f6b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874205065951616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381509.454124:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f6b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874205065951616:12345-0@lo:400:kworker.0 Request processed in 43us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381509.454131:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787381509.454145:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787381509.454151:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a800380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874205065951872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381509.454180:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a800380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874205065951872:12345-0@lo:400:kworker.0 Request processed in 30us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381509.454186:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787381509.454198:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787381509.454204:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a52b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874205065951744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381509.454409:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a52b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874205065951744:12345-0@lo:400:kworker.0 Request processed in 204us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381509.454415:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787381509.455059:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1645add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874205065951616:0@lo:400:kworker.0 00000100:00100000:2.0:1787381509.455094:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a802300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1874205065951744:0@lo:400:kworker.0 00000100:00100000:2.0:1787381509.455103:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a801500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1874205065951872:0@lo:400:kworker.0 00000100:00100000:3.0:1787381509.455765:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065951488 00000100:00100000:3.0:1787381509.455781:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065951488 00000100:00100000:3.0:1787381509.455858:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1787381509.455870:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+19:3310:x1874205065951488:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787381509.455921:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787381509.455928:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787381509.455931:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787381509.456404:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+19:3310:x1874205065951488:12345-0@lo:400:kworker.0 Request processed in 535us (2980us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381509.456743:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1787381509.458281:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1645add180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd19486c-5291-4823-bb9c-f3a73416a496:3310:1874205065951488:0@lo:400:kworker.0 00000100:00100000:3.0:1787381509.964588:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a801500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065952128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787381509.964661:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381509.964789:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065952128 00000100:00100000:2.0:1787381509.964798:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065952128 00000100:00100000:2.0:1787381509.964867:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787381509.964877:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fb24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065952128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787381509.964920:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787381509.964972:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fb24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065952128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381509.964993:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787381509.965341:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a801500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065952128:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787381510.028806:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381511.052222:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787381511.311606:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381511.311646:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381511.311681:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381511.311710:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381511.311753:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381511.311783:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047099008 00000100:00100000:2.0:1787381511.311792:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047099008 00000100:00100000:0.0:1787381511.311933:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047098496 00000100:00100000:0.0:1787381511.311938:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047098496 00000100:00100000:0.0:1787381511.311981:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 301 00000100:00100000:0.0:1787381511.311999:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2350:x1874205047098496:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787381511.312098:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2350:x1874205047098496:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 109us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381511.312105:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 301 00000100:00100000:3.0:1787381511.312236:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047098624 00000100:00100000:3.0:1787381511.312240:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047098624 00000100:00100000:1.0:1787381511.312295:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047098752 00000100:00100000:1.0:1787381511.312299:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047098752 00000100:00100000:1.0:1787381511.312339:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047098880 00000100:00100000:1.0:1787381511.312342:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047098880 00000100:00100000:1.0:1787381511.312360:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 81 00000100:00100000:1.0:1787381511.312367:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2157c09-10df-40cb-8228-ad4822122c97+7:2350:x1874205047098752:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787381511.312402:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a802300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2157c09-10df-40cb-8228-ad4822122c97+7:2350:x1874205047098752:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 35us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381511.312408:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 81 00000100:00100000:1.0:1787381511.312421:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 82 00000100:00100000:1.0:1787381511.312427:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645add500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2157c09-10df-40cb-8228-ad4822122c97+5:2350:x1874205047098880:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787381511.312450:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645add500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2157c09-10df-40cb-8228-ad4822122c97+5:2350:x1874205047098880:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 25us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381511.312456:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 82 00000100:00100000:2.0:1787381511.312970:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 163 00000100:00080000:0.0:1787381511.313027:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787381511.314485:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 164 00000100:00100000:3.0:1787381511.314498:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+19:2350:x1874205047098624:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381511.314567:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645add180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f2157c09-10df-40cb-8228-ad4822122c97+19:2350:x1874205047098624:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 73us (2857us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381511.314574:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 164 00000100:00100000:2.0:1787381511.314623:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a801500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+6:2350:x1874205047099008:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787381511.314648:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a801500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+6:2350:x1874205047099008:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 1672us (2968us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381511.314655:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 163 00000100:00080000:0.0:1787381511.314705:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787381511.314719:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1787381512.056323:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1787381512.056343:0:5813:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1787381512.056387:0:5825:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1787381512.056399:0:5825:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1787381512.079258:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381513.104330:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787381513.194976:0:12612:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 02:51:50 (1787381510) 00010000:00010000:0.0:1787381514.128515:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787381514.195232:0:11528:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787381514.195241:0:11528:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787381514.195898:0:11528:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1787381514.195905:0:11528:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787381514.572366:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f933480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874205065952384:0@lo:400:kworker.0 00000100:00100000:2.0:1787381514.572492:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381514.572546:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f932a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065952896:0@lo:400:kworker.0 00000100:00100000:2.0:1787381514.572571:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381514.572608:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787381514.572614:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1645b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd19486c-5291-4823-bb9c-f3a73416a496:3309:1874205065952256:0@lo:400:kworker.0 00000100:00100000:2.0:1787381514.572638:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381514.572656:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1874205065952768:0@lo:400:kworker.0 00000100:00100000:2.0:1787381514.572686:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381514.572709:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f930380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1874205065952512:0@lo:400:kworker.0 00000100:00100000:2.0:1787381514.572727:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381514.572741:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787381514.572745:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f931f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065952640:0@lo:400:kworker.0 00000100:00100000:2.0:1787381514.572761:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381514.572786:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065952384 00000100:00100000:2.0:1787381514.572792:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065952384 00000100:00100000:2.0:1787381514.572826:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065952768 00000100:00100000:2.0:1787381514.572829:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065952768 00000100:00100000:2.0:1787381514.572848:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065952512 00000100:00100000:2.0:1787381514.572850:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065952512 00000100:00100000:2.0:1787381514.572863:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787381514.572870:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1681723480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874205065952384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381514.572928:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1681723480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874205065952384:12345-0@lo:400:kworker.0 Request processed in 57us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381514.572935:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1787381514.572953:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787381514.572958:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1681720380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874205065952768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381514.572983:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1681720380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874205065952768:12345-0@lo:400:kworker.0 Request processed in 25us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381514.572989:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787381514.572999:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787381514.573051:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1681721500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874205065952512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381514.573082:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1681721500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874205065952512:12345-0@lo:400:kworker.0 Request processed in 77us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381514.573097:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787381514.573116:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065952896 00000100:00100000:2.0:1787381514.573119:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065952896 00000100:00100000:2.0:1787381514.573144:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065952640 00000100:00100000:2.0:1787381514.573147:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065952640 00000100:00100000:2.0:1787381514.573165:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787381514.573170:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1681720e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065952896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381514.573198:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1681720e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065952896:12345-0@lo:400:kworker.0 Request processed in 28us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381514.573204:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787381514.573214:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787381514.573221:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1681722300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065952640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381514.573249:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1681722300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065952640:12345-0@lo:400:kworker.0 Request processed in 29us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381514.573255:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787381514.573274:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065952256 00000100:00100000:2.0:1787381514.573278:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065952256 00000100:00100000:2.0:1787381514.573300:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1787381514.573305:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+19:3309:x1874205065952256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381514.573331:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cd19486c-5291-4823-bb9c-f3a73416a496+19:3309:x1874205065952256:12345-0@lo:400:kworker.0 Request processed in 25us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381514.573337:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00080000:2.0:1787381514.573374:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787381514.573378:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787381514.573380:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787381514.573410:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f931f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065952640:0@lo:400:kworker.0 00000100:00100000:2.0:1787381514.573430:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f930380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1874205065952512:0@lo:400:kworker.0 00000100:00100000:2.0:1787381514.573459:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1645b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd19486c-5291-4823-bb9c-f3a73416a496:3309:1874205065952256:0@lo:400:kworker.0 00000100:00100000:2.0:1787381514.573468:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1874205065952768:0@lo:400:kworker.0 00000100:00100000:2.0:1787381514.573477:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f933480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874205065952384:0@lo:400:kworker.0 00000100:00100000:2.0:1787381514.573486:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f932a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065952896:0@lo:400:kworker.0 00000100:00100000:0.0:1787381514.575394:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787381514.575416:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a52ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065953024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787381514.575478:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381514.575525:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065953024 00000100:00100000:0.0:1787381514.575532:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065953024 00000100:00100000:0.0:1787381514.575697:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787381514.575706:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a528a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065953024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787381514.575815:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787381514.575857:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a528a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065953024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381514.575865:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787381514.576112:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a52ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065953024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787381515.087107:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a52ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065953152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787381515.087181:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381515.087245:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065953152 00000100:00100000:0.0:1787381515.087253:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065953152 00000100:00100000:0.0:1787381515.087292:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787381515.087301:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065953152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787381515.087336:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787381515.087379:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065953152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381515.087386:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787381515.087432:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a52ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065953152:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787381515.148317:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381516.172962:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787381516.429654:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381516.429696:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381516.429734:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381516.429760:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381516.429785:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381516.429822:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047099648 00000100:00100000:3.0:1787381516.429832:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047099648 00000100:00100000:3.0:1787381516.429893:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047099264 00000100:00100000:3.0:1787381516.429896:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047099264 00000100:00100000:3.0:1787381516.429919:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 168 00000100:00100000:3.0:1787381516.429929:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fb25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+6:2349:x1874205047099648:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381516.430054:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fb25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+6:2349:x1874205047099648:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 125us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381516.430062:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 168 00000100:00100000:3.0:1787381516.430082:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 169 00000100:00100000:3.0:1787381516.430089:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1543324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+18:2349:x1874205047099264:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381516.430118:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1543324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f2157c09-10df-40cb-8228-ad4822122c97+18:2349:x1874205047099264:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 27us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381516.430124:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 169 00000100:00100000:1.0:1787381516.430210:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047099392 00000100:00100000:1.0:1787381516.430228:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047099392 00000100:00100000:1.0:1787381516.430265:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047099520 00000100:00100000:1.0:1787381516.430268:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047099520 00000100:00100000:1.0:1787381516.430293:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 85 00000100:00100000:1.0:1787381516.430299:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fb27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2157c09-10df-40cb-8228-ad4822122c97+7:2349:x1874205047099392:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787381516.430335:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fb27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2157c09-10df-40cb-8228-ad4822122c97+7:2349:x1874205047099392:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 36us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381516.430342:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 85 00000100:00100000:1.0:1787381516.430357:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 86 00000100:00100000:1.0:1787381516.430363:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1543327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2157c09-10df-40cb-8228-ad4822122c97+5:2349:x1874205047099520:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787381516.430385:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1543327b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2157c09-10df-40cb-8228-ad4822122c97+5:2349:x1874205047099520:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 23us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381516.430390:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 86 00000100:00080000:2.0:1787381516.430727:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787381516.430732:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787381516.430735:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787381516.430819:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047099136 00000100:00100000:0.0:1787381516.430825:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047099136 00000100:00100000:0.0:1787381516.430869:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 303 00000100:00100000:0.0:1787381516.430876:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2349:x1874205047099136:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787381516.430920:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2349:x1874205047099136:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 44us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381516.430927:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 303 00010000:00010000:1.0:1787381517.204071:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787381517.496791:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381517.497149:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047099904 00000100:00100000:1.0:1787381517.497158:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047099904 00000100:00100000:1.0:1787381517.497219:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 66 00000100:00100000:1.0:1787381517.497230:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1543324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+18:12285:x1874205047099904:12345-192.168.203.22@tcp:35:umount.0 00000100:00100000:1.0:1787381517.498317:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1543324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+19:12285:x1874205047099904:12345-192.168.203.22@tcp:35:umount.0 Request processed in 1083us (1532us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1787381517.498327:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 66 00000100:00100000:1.0:1787381517.505937:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381517.506040:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047100160 00000100:00100000:0.0:1787381517.506050:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047100160 00000100:00100000:0.0:1787381517.506109:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 67 00000100:00100000:0.0:1787381517.506119:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+19:12285:x1874205047100160:12345-192.168.203.22@tcp:35:umount.0 00000100:00100000:0.0:1787381517.506539:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+20:12285:x1874205047100160:12345-192.168.203.22@tcp:35:umount.0 Request processed in 419us (686us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1787381517.506548:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 67 00000100:00100000:2.0:1787381517.510628:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381517.511162:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047100416 00000100:00100000:0.0:1787381517.511172:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047100416 00000100:00100000:0.0:1787381517.511291:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 68 00000100:00100000:0.0:1787381517.511301:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166d3b8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+20:12285:x1874205047100416:12345-192.168.203.22@tcp:35:umount.0 00000100:00100000:0.0:1787381517.511744:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166d3b8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f2157c09-10df-40cb-8228-ad4822122c97+21:12285:x1874205047100416:12345-192.168.203.22@tcp:35:umount.0 Request processed in 443us (1123us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1787381517.511753:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 68 00000100:00100000:3.0:1787381517.515172:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381517.515442:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047100672 00000100:00100000:2.0:1787381517.515452:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047100672 00000100:00100000:2.0:1787381517.515494:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 69 00000100:00100000:2.0:1787381517.515503:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1543324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+21:12285:x1874205047100672:12345-192.168.203.22@tcp:35:umount.0 00000100:00100000:2.0:1787381517.515826:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1543324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f2157c09-10df-40cb-8228-ad4822122c97+22:12285:x1874205047100672:12345-192.168.203.22@tcp:35:umount.0 Request processed in 322us (663us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1787381517.515834:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 69 00000100:00100000:2.0:1787381517.528179:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381517.528220:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381517.528259:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381517.528335:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047100800 00000100:00100000:1.0:1787381517.528346:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047100800 00000100:00100000:1.0:1787381517.528403:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047100928 00000100:00100000:1.0:1787381517.528407:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047100928 00000100:00100000:1.0:1787381517.528425:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:1.0:1787381517.528434:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1645b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c93c8548-229c-4d2f-8357-13904b6fe0fb+14:2350:x1874205047100800:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787381517.528450:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381517.528468:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1541388200/0xbdc38ada7ea0f99a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953624 expref: 14 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381517.528498:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381517.528571:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1645b72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c93c8548-229c-4d2f-8357-13904b6fe0fb+13:2350:x1874205047100800:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 137us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381517.528580:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:1.0:1787381517.528598:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:1.0:1787381517.528605:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f932a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c93c8548-229c-4d2f-8357-13904b6fe0fb+12:2350:x1874205047100928:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787381517.528614:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381517.528624:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1681733800/0xbdc38ada7ea0fbae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536ef expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381517.528633:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381517.528649:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f932a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c93c8548-229c-4d2f-8357-13904b6fe0fb+11:2350:x1874205047100928:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 45us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381517.528656:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:0.0:1787381517.529745:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047101056 00000100:00100000:0.0:1787381517.529756:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047101056 00000100:00100000:0.0:1787381517.529798:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 72 00000100:00100000:0.0:1787381517.529806:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2157c09-10df-40cb-8228-ad4822122c97+5:2348:x1874205047101056:12345-192.168.203.22@tcp:9:umount.0 00000020:00000080:0.0:1787381517.529834:0:6587:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbdc38ada7ea0fc72 00000100:00080000:0.0:1787381517.529960:0:6587:0:(import.c:65:import_set_state_nolock()) ffff9a1675339000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787381517.530068:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1787381517.530126:0:6587:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1787381517.530437:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f933480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f2157c09-10df-40cb-8228-ad4822122c97+2:2348:x1874205047101056:12345-192.168.203.22@tcp:9:umount.0 Request processed in 629us (2175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381517.530445:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 72 00000100:00100000:2.0:1787381517.536671:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381517.536799:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047101184 00000100:00100000:1.0:1787381517.536809:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047101184 00000100:00100000:1.0:1787381517.536881:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:1.0:1787381517.536890:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f932d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c93c8548-229c-4d2f-8357-13904b6fe0fb+11:2349:x1874205047101184:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787381517.536906:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381517.536925:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a164166b200/0xbdc38ada7ea0f900 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9535ec expref: 11 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381517.536941:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381517.536999:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f932d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:2349:x1874205047101184:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 109us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381517.537054:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:3.0:1787381517.551297:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381517.551433:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047101568 00000100:00100000:2.0:1787381517.551443:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047101568 00000100:00100000:2.0:1787381517.551499:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 73 00000100:00100000:2.0:1787381517.551509:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1543324700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2157c09-10df-40cb-8228-ad4822122c97+7:2348:x1874205047101568:12345-192.168.203.22@tcp:9:umount.0 00000020:00000080:2.0:1787381517.551564:0:7779:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbdc38ada7ea0fed3 00000020:00010000:2.0:1787381517.551573:0:7779:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a1658057000: total 0 00000100:00080000:2.0:1787381517.551578:0:7779:0:(import.c:65:import_set_state_nolock()) ffff9a167533b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787381517.551623:0:7779:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1787381517.551909:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1543324700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f2157c09-10df-40cb-8228-ad4822122c97+5:2348:x1874205047101568:12345-192.168.203.22@tcp:9:umount.0 Request processed in 399us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381517.551917:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 73 00000020:00010000:1.0:1787381517.552314:0:5779:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a1658057000: total 0 00010000:00010000:1.0:1787381517.552350:0:5779:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a1658057000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1787381517.552402:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec873412/0xbdc38ada7ea10276 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538c4 expref: 4 pid: 6588 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381517.552433:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a99c7a2e/0xbdc38ada7ea10914 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a92 expref: 3 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381517.552449:0:5779:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a1658057000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1787381517.552460:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381517.552462:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381517.552464:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787381517.570464:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381517.570540:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047102592 00000100:00100000:2.0:1787381517.570550:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047102592 00000100:00100000:2.0:1787381517.570603:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 240 00000100:00100000:2.0:1787381517.570612:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+22:2348:x1874205047102592:12345-192.168.203.22@tcp:39:umount.0 00000020:00000080:2.0:1787381517.570643:0:5792:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbdc38ada7ea0f90e 00000020:00010000:2.0:1787381517.570658:0:5792:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a166d143800: total 0 00000100:00080000:2.0:1787381517.570662:0:5792:0:(import.c:65:import_set_state_nolock()) ffff9a1675360000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787381517.570691:0:5792:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:2.0:1787381517.571126:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a807800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f2157c09-10df-40cb-8228-ad4822122c97+21:2348:x1874205047102592:12345-192.168.203.22@tcp:39:umount.0 Request processed in 513us (669us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1787381517.571134:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 240 00000020:00010000:0.0:1787381517.571696:0:5778:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a166d143800: total 0 00010000:00010000:0.0:1787381517.571701:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381517.571743:0:5778:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a166d143800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1787381517.571806:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a1643052a00) 00010000:00010000:0.0:1787381517.571810:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787381517.571818:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1e00/0xbdc38ada7ea0fc48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953719 expref: 20 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381517.571847:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a1643052600) 00010000:00010000:0.0:1787381517.571862:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787381517.571867:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea107f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a45 expref: 19 pid: 11324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381517.571883:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a1643af1d00) 00010000:00010000:0.0:1787381517.571886:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787381517.571890:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c9400/0xbdc38ada7ea102f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538e7 expref: 18 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381517.571902:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a1643052700) 00010000:00010000:0.0:1787381517.571905:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787381517.571909:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea10157 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953877 expref: 17 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381517.571942:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a1643052000) 00010000:00010000:0.0:1787381517.571944:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787381517.571949:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0e00/0xbdc38ada7ea0fbf4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953704 expref: 16 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381517.571966:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a1643052600) 00010000:00010000:0.0:1787381517.571968:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787381517.571971:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8600/0xbdc38ada7ea108ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a8b expref: 15 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381517.571981:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a1643052700) 00010000:00010000:0.0:1787381517.571983:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787381517.571986:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733200/0xbdc38ada7ea10237 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538af expref: 14 pid: 8469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381517.571995:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9a1643052600) 00010000:00010000:0.0:1787381517.571997:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787381517.572000:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0200/0xbdc38ada7ea108d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a7d expref: 13 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381517.572062:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1650b8f100) 00010000:00010000:0.0:1787381517.572064:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787381517.572068:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733400/0xbdc38ada7ea102d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538e0 expref: 12 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381517.572081:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9a1643052a00) 00010000:00010000:0.0:1787381517.572084:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787381517.572097:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0000/0xbdc38ada7ea0ff35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9537eb expref: 11 pid: 5792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381517.572114:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a1650b8f400) 00010000:00010000:0.0:1787381517.572117:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787381517.572120:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681733a00/0xbdc38ada7ea0fbd8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536fd expref: 10 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381517.572133:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9a1643052700) 00010000:00010000:0.0:1787381517.572135:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787381517.572139:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1681732a00/0xbdc38ada7ea10261 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9538bd expref: 9 pid: 5790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381517.572151:0:5778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9a1643af1d00) 00010000:00010000:0.0:1787381517.572153:0:5778:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787381517.572156:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0a00/0xbdc38ada7ea105d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9539b9 expref: 8 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381517.572166:0:5778:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a166d143800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1787381517.572178:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381517.572179:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381517.572181:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381518.222817:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381519.244558:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787381519.692633:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f930380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065953280:0@lo:400:kworker.0 00000100:00100000:2.0:1787381519.692665:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065953664:0@lo:400:kworker.0 00000100:00100000:1.0:1787381519.692772:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1874205065953536:0@lo:400:kworker.0 00000100:00100000:0.0:1787381519.692996:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a166f931f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874205065953408:0@lo:400:kworker.0 00000100:00100000:2.0:1787381519.694074:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381519.694160:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065953664 00000100:00100000:2.0:1787381519.694168:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065953664 00000100:00100000:2.0:1787381519.694235:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787381519.694244:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065953664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381519.694298:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065953664:12345-0@lo:400:kworker.0 Request processed in 55us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381519.694320:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1787381519.694340:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787381519.694371:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065953664:0@lo:400:kworker.0 00000100:00100000:2.0:1787381519.694457:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787381519.694466:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065954048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787381519.694495:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381519.695271:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065954048 00000100:00100000:2.0:1787381519.695280:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065954048 00000100:00100000:2.0:1787381519.695320:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787381519.695328:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065954048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787381519.695362:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787381519.695409:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065954048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381519.695416:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787381519.695454:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065954048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787381519.698799:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381519.698872:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381519.698954:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1874205065953792:0@lo:400:kworker.0 00000100:00100000:1.0:1787381519.698975:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065953536 00000100:00100000:1.0:1787381519.698983:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065953536 00000100:00100000:3.0:1787381519.699000:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381519.699055:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065953792 00000100:00100000:3.0:1787381519.699061:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065953792 00000100:00100000:1.0:1787381519.699079:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787381519.699102:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787381519.699109:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874205065953792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381519.699197:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874205065953536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381519.699372:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874205065953536:12345-0@lo:400:kworker.0 Request processed in 282us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381519.699380:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:1.0:1787381519.699404:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787381519.699498:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1874205065953536:0@lo:400:kworker.0 00000100:00100000:0.0:1787381519.699923:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381519.699959:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065953920:0@lo:400:kworker.0 00000100:00100000:0.0:1787381519.699985:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381519.700184:0:8469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065953408 00000100:00100000:1.0:1787381519.700514:0:8469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065953408 00000100:00100000:1.0:1787381519.700552:0:8469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787381519.700560:0:8469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874205065953408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381519.700607:0:8469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874205065953408:12345-0@lo:400:kworker.0 Request processed in 48us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381519.700614:0:8469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1787381519.700724:0:7779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065953920 00000100:00100000:1.0:1787381519.700728:0:7779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065953920 00000100:00100000:1.0:1787381519.700761:0:7779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787381519.700767:0:7779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a52ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065953920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381519.700800:0:7779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a52ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065953920:12345-0@lo:400:kworker.0 Request processed in 33us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381519.700806:0:7779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:1.0:1787381519.700821:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787381519.700855:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f931f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874205065953408:0@lo:400:kworker.0 00000100:00100000:1.0:1787381519.700868:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065953920:0@lo:400:kworker.0 00000100:00100000:3.0:1787381519.702548:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1874205065953792:12345-0@lo:400:kworker.0 Request processed in 3429us (3537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381519.702562:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787381519.702622:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1874205065953792:0@lo:400:kworker.0 00000100:00100000:2.0:1787381519.708082:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065953280 00000100:00100000:2.0:1787381519.708097:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065953280 00000100:00100000:2.0:1787381519.708224:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1787381519.708235:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16464c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+19:3308:x1874205065953280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381519.709738:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16464c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cd19486c-5291-4823-bb9c-f3a73416a496+19:3308:x1874205065953280:12345-0@lo:400:kworker.0 Request processed in 1498us (10940us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381519.709752:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1787381519.710290:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a166f930380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065953280:0@lo:400:kworker.0 00000100:00100000:0.0:1787381519.847993:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381519.848212:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381519.848309:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381519.848643:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381519.848684:0:11324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047103232 00000100:00100000:0.0:1787381519.848693:0:11324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047103232 00000100:00100000:0.0:1787381519.848764:0:11324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 241 00000100:00100000:0.0:1787381519.848786:0:11324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542861880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+6:2348:x1874205047103232:12345-192.168.203.22@tcp:39:umount.0 00000020:00000080:0.0:1787381519.848824:0:11324:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbdc38ada7ea0f9f5 00000020:00010000:0.0:1787381519.848832:0:11324:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a1675360800: total 0 00000100:00080000:0.0:1787381519.848848:0:11324:0:(import.c:65:import_set_state_nolock()) ffff9a1675367800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787381519.848869:0:11324:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1787381519.849103:0:11324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542861880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:76f8c15f-81f9-4e6f-a311-d4cb5f530dfa+5:2348:x1874205047103232:12345-192.168.203.22@tcp:39:umount.0 Request processed in 318us (459us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1787381519.849112:0:11324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 241 00000100:00080000:0.0:1787381519.849228:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:0.0:1787381519.849243:0:5779:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a1675360800: total 0 00010000:00010000:0.0:1787381519.849541:0:5779:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a1675360800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1787381519.849578:0:5779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1650b8f100) 00010000:00010000:0.0:1787381519.849582:0:5779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787381519.849590:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16460c8200/0xbdc38ada7ea10922 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953a99 expref: 4 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381519.849612:0:5779:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a1675360800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1787381519.849624:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381519.849626:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381519.849628:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787381519.850241:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047102720 00000100:00100000:1.0:1787381519.850346:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047102720 00000100:00100000:1.0:1787381519.850387:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047102848 00000100:00100000:1.0:1787381519.850391:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047102848 00000100:00100000:1.0:1787381519.850402:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047102976 00000100:00100000:1.0:1787381519.850405:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047102976 00000100:00100000:1.0:1787381519.850420:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:1.0:1787381519.850427:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542862300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c93c8548-229c-4d2f-8357-13904b6fe0fb+12:2349:x1874205047102720:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787381519.850440:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381519.850453:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1681732200/0xbdc38ada7ea0f9e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953639 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381519.850482:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381519.850539:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542862300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c93c8548-229c-4d2f-8357-13904b6fe0fb+11:2349:x1874205047102720:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 112us (2556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381519.850547:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:1.0:1787381519.850564:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 24 00000100:00100000:1.0:1787381519.850570:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542860700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c93c8548-229c-4d2f-8357-13904b6fe0fb+10:2349:x1874205047102848:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787381519.850578:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381519.850588:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1681733e00/0xbdc38ada7ea0f9e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953663 expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381519.850597:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381519.850615:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542860700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c93c8548-229c-4d2f-8357-13904b6fe0fb+9:2349:x1874205047102848:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 45us (2403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381519.850621:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 24 00000100:00100000:1.0:1787381519.850632:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:1.0:1787381519.850638:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1665877c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c93c8548-229c-4d2f-8357-13904b6fe0fb+8:2351:x1874205047102976:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787381519.850645:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381519.850652:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1647eb0c00/0xbdc38ada7ea0fba7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a9536e8 expref: 8 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381519.850660:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381519.850680:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1665877c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c93c8548-229c-4d2f-8357-13904b6fe0fb+7:2351:x1874205047102976:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 42us (2372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381519.850685:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:0.0:1787381519.885685:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381519.885883:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047103488 00000100:00100000:2.0:1787381519.885894:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047103488 00000100:00100000:2.0:1787381519.885949:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 305 00000100:00100000:2.0:1787381519.885959:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1650553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+7:2348:x1874205047103488:12345-192.168.203.22@tcp:251:umount.0 00000020:00000080:2.0:1787381519.886053:0:5783:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbdc38ada7ea0f8eb 00000020:00010000:2.0:1787381519.886060:0:5783:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a1675067000: total 0 00000100:00080000:2.0:1787381519.886064:0:5783:0:(import.c:65:import_set_state_nolock()) ffff9a1675061800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787381519.886155:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1650553c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c93c8548-229c-4d2f-8357-13904b6fe0fb+3:2348:x1874205047103488:12345-192.168.203.22@tcp:251:umount.0 Request processed in 195us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381519.886162:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 305 00000020:00010000:3.0:1787381519.886497:0:5778:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a1675067000: total 0 00010000:00010000:3.0:1787381519.886501:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381519.886546:0:5778:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a1675067000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787381519.886581:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1647eb0400/0xbdc38ada7ea0f9a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a95362b expref: 2 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381519.886596:0:5778:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a1675067000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1787381519.886605:0:5778:0:(genops.c:906:class_export_put()) final put ffff9a1675067000/c93c8548-229c-4d2f-8357-13904b6fe0fb 00010000:00010000:3.0:1787381519.886623:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381519.886625:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381519.886626:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787381519.887522:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a1675067000/c93c8548-229c-4d2f-8357-13904b6fe0fb for MGS 00000020:00000080:2.0:1787381519.887572:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a1675061800 for MGS 00000100:00100000:3.0:1787381520.206152:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065954176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787381520.206223:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381520.206390:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065954176 00000100:00100000:2.0:1787381520.206398:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065954176 00000100:00100000:2.0:1787381520.206454:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787381520.206463:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065954176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787381520.206496:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787381520.206544:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065954176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381520.206551:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787381520.206591:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065954176:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787381520.268232:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381521.292613:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787381521.550415:0:12810:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787381521.570557:0:12810:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1787381521.570609:0:12810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a168216d200/0xbdc38ada7ea0f970 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f977 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381521.570623:0:12810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a168216d200/0xbdc38ada7ea0f970 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f977 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381521.571265:0:12810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a168216d200/0xbdc38ada7ea0f970 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xbdc38ada7ea0f977 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381521.571273:0:12810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9a168216d200/0xbdc38ada7ea0f970 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xbdc38ada7ea0f977 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381521.571331:0:12810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787381521.571337:0:12810:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787381521.571365:0:12810:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787381521.571369:0:12810:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787381521.571375:0:12810:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787381521.571400:0:12810:0:(import.c:65:import_set_state_nolock()) ffff9a166fcae000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787381521.571455:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874205065954304:0@lo:39:umount.0 00010000:00010000:1.0:1787381521.571459:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787381521.571478:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a168216d200/0xbdc38ada7ea0f970 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xbdc38ada7ea0f977 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381521.571486:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a168216d200 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:1.0:1787381521.571489:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a168216d200/0xbdc38ada7ea0f970 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xbdc38ada7ea0f977 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381521.571498:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a168216d200/0xbdc38ada7ea0f970 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xbdc38ada7ea0f977 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787381521.571504:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a168216d200/0xbdc38ada7ea0f970 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xbdc38ada7ea0f977 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787381521.571509:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787381521.571512:0:5779:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787381521.571514:0:5779:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:2.0:1787381521.571535:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787381521.571621:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a168216d200/0xbdc38ada7ea0f970 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xbdc38ada7ea0f977 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381521.571651:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065954304 00000100:00100000:3.0:1787381521.571659:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065954304 00000100:00100000:3.0:1787381521.571723:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787381521.571732:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874205065954304:12345-0@lo:39:umount.0 00000020:00000080:3.0:1787381521.571756:0:5791:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbdc38ada7ea0f6fa 00000100:00080000:3.0:1787381521.571764:0:5791:0:(import.c:65:import_set_state_nolock()) ffff9a1645b49800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787381521.571786:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787381521.571805:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a168216d200/0xbdc38ada7ea0f970 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xbdc38ada7ea0f977 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381521.571813:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a168216d200/0xbdc38ada7ea0f970 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xbdc38ada7ea0f977 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381521.571833:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3307:x1874205065954304:12345-0@lo:39:umount.0 Request processed in 92us (288us total) trans 0 rc 0/0 00010000:00010000:0.0:1787381521.571834:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787381521.571841:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00010000:00010000:0.0:1787381521.571842:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381521.571844:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787381521.571851:0:5791:0:(genops.c:906:class_export_put()) final put ffff9a1645b4d000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1787381521.571875:0:2586:0:(genops.c:865:class_export_destroy()) destroying export ffff9a1645b4d000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:3.0:1787381521.571877:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542861180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065954432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787381521.571904:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1787381521.571918:0:2586:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a1645b49800 for lustre-MDT0000 00000100:00100000:1.0:1787381521.572107:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065954432 00000100:00100000:1.0:1787381521.572112:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065954432 00000100:00100000:1.0:1787381521.572149:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787381521.572155:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd19486c-5291-4823-bb9c-f3a73416a496+19:3308:x1874205065954432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787381521.572165:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381521.572178:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1541389200/0xbdc38ada7ea0f977 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbdc38ada7ea0f970 expref: 19 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381521.572190:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381521.572229:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd19486c-5291-4823-bb9c-f3a73416a496+18:3308:x1874205065954432:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381521.572236:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787381521.572265:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542861180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065954432:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787381521.572381:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787381521.572407:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9a166fcae000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1787381521.572428:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874205065954304:0@lo:39:umount.0 00000100:00080000:0.0:1787381521.572509:0:12810:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787381521.572512:0:12810:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787381521.572517:0:12810:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787381521.576863:0:12810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1541388e00/0xbdc38ada7ea0f97e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f985 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381521.576883:0:12810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1541388e00/0xbdc38ada7ea0f97e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f985 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381521.576892:0:12810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1541388e00/0xbdc38ada7ea0f97e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xbdc38ada7ea0f985 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381521.576899:0:12810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9a1541388e00/0xbdc38ada7ea0f97e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xbdc38ada7ea0f985 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381521.576931:0:12810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787381521.576939:0:12810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1640031600/0xbdc38ada7ea0f8a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f8ac expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381521.576946:0:12810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1640031600/0xbdc38ada7ea0f8a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f8ac expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381521.576952:0:12810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1640031600/0xbdc38ada7ea0f8a5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbdc38ada7ea0f8ac expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381521.576976:0:12810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9a1640031600/0xbdc38ada7ea0f8a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbdc38ada7ea0f8ac expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381521.577141:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787381521.577149:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a1541388e00/0xbdc38ada7ea0f97e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xbdc38ada7ea0f985 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381521.577165:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388e00 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:2.0:1787381521.577169:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a1541388e00/0xbdc38ada7ea0f97e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xbdc38ada7ea0f985 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381521.577177:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a1541388e00/0xbdc38ada7ea0f97e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xbdc38ada7ea0f985 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787381521.577183:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a1541388e00/0xbdc38ada7ea0f97e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xbdc38ada7ea0f985 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787381521.577187:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787381521.577189:0:5779:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1787381521.577223:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a1541388e00/0xbdc38ada7ea0f97e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xbdc38ada7ea0f985 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381521.577229:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787381521.577253:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a1541388e00/0xbdc38ada7ea0f97e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xbdc38ada7ea0f985 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381521.577259:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a1541388e00/0xbdc38ada7ea0f97e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xbdc38ada7ea0f985 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381521.577273:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381521.577275:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381521.577277:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787381521.577286:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787381521.577306:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065954560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787381521.577377:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381521.577429:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065954560 00000100:00100000:2.0:1787381521.577443:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065954560 00000100:00100000:2.0:1787381521.577511:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787381521.577521:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd19486c-5291-4823-bb9c-f3a73416a496+18:3308:x1874205065954560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787381521.577534:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381521.577549:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a168216c800/0xbdc38ada7ea0f985 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbdc38ada7ea0f97e expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381521.577562:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787381521.577596:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd19486c-5291-4823-bb9c-f3a73416a496+17:3308:x1874205065954560:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381521.577603:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787381521.577641:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065954560:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787381521.577981:0:12810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787381521.578111:0:12810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea0fb99 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0fba0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381521.578120:0:12810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea0fb99 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0fba0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381521.578126:0:12810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea0fb99 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbdc38ada7ea0fba0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381521.578132:0:12810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea0fb99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbdc38ada7ea0fba0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381521.578997:0:12810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787381521.579034:0:12810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a16413a1200/0xbdc38ada7ea0f659 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f660 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381521.579045:0:12810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a16413a1200/0xbdc38ada7ea0f659 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f660 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381521.579052:0:12810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a16413a1200/0xbdc38ada7ea0f659 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbdc38ada7ea0f660 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381521.579058:0:12810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9a16413a1200/0xbdc38ada7ea0f659 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbdc38ada7ea0f660 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381521.579876:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787381521.579887:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a1640031600/0xbdc38ada7ea0f8a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbdc38ada7ea0f8ac expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381521.579896:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1640031600 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:2.0:1787381521.579900:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a1640031600/0xbdc38ada7ea0f8a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbdc38ada7ea0f8ac expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381521.579910:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a1640031600/0xbdc38ada7ea0f8a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xbdc38ada7ea0f8ac expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787381521.579917:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a1640031600/0xbdc38ada7ea0f8a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xbdc38ada7ea0f8ac expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787381521.579923:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787381521.579925:0:5778:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1787381521.579928:0:5778:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1787381521.579973:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a1640031600/0xbdc38ada7ea0f8a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbdc38ada7ea0f8ac expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381521.579979:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787381521.580343:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787381521.580702:0:12811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787381521.580706:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a1640031600/0xbdc38ada7ea0f8a5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbdc38ada7ea0f8ac expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381521.580725:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a1640031600/0xbdc38ada7ea0f8a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbdc38ada7ea0f8ac expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381521.580744:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381521.580745:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381521.580747:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787381521.580765:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd19486c-5291-4823-bb9c-f3a73416a496:3310:1874205065954688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787381521.580839:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381521.580881:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065954688 00000100:00100000:3.0:1787381521.580888:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065954688 00000100:00100000:3.0:1787381521.580939:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787381521.580949:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd19486c-5291-4823-bb9c-f3a73416a496+17:3310:x1874205065954688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787381521.580962:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787381521.580977:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a16413a1000/0xbdc38ada7ea0f8ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbdc38ada7ea0f8a5 expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381521.580991:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787381521.581035:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea0fb99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbdc38ada7ea0fba0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381521.581053:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541389400 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:1.0:1787381521.581057:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea0fb99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbdc38ada7ea0fba0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381521.581065:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea0fb99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbdc38ada7ea0fba0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787381521.581071:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea0fb99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbdc38ada7ea0fba0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787381521.581076:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787381521.581079:0:5779:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787381521.581082:0:5779:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787381521.581100:0:5779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea0fb99 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xbdc38ada7ea0fba0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381521.581107:0:5779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787381521.581110:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cd19486c-5291-4823-bb9c-f3a73416a496+16:3310:x1874205065954688:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (271us total) trans 0 rc 0/0 00010000:00010000:1.0:1787381521.581116:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea0fb99 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xbdc38ada7ea0fba0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381521.581118:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:1.0:1787381521.581123:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea0fb99 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xbdc38ada7ea0fba0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381521.581132:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381521.581133:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381521.581135:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787381521.581142:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd19486c-5291-4823-bb9c-f3a73416a496:3311:1874205065954816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787381521.581170:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787381521.581170:0:12810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:0.0:1787381521.581177:0:12810:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1787381521.581182:0:12810:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1787381521.581212:0:12810:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1787381521.581216:0:12810:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1787381521.581220:0:12810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787381521.581226:0:12810:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:0.0:1787381521.581231:0:12810:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9a16436a3800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787381521.581236:0:12810:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9a167f6ec800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787381521.581243:0:12810:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9a1675360800 76f8c15f-81f9-4e6f-a311-d4cb5f530dfa 192.168.203.22@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787381521.581248:0:12810:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9a166d143800 f2157c09-10df-40cb-8228-ad4822122c97 192.168.203.22@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967520 stale:0 00000020:00080000:0.0:1787381521.581253:0:12810:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9a166fc98000) has exports, disconnecting them 00000020:00080000:0.0:1787381521.581257:0:12810:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a16436a3800), last request at 1787381519 00000020:00000080:0.0:1787381521.581263:0:12810:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbdc38ada7ea0f86d 00000100:00080000:0.0:1787381521.581279:0:12810:0:(import.c:65:import_set_state_nolock()) ffff9a16436a1800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1787381521.581312:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cd19486c-5291-4823-bb9c-f3a73416a496:3310:1874205065954688:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1787381521.581321:0:12810:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a16436a3800): rc 0 00000020:00000080:0.0:1787381521.581323:0:12810:0:(genops.c:906:class_export_put()) final put ffff9a16436a3800/lustre-MDT0000-lwp-OST0001_UUID 00000100:00100000:2.0:1787381521.581334:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065954816 00000100:00100000:2.0:1787381521.581337:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065954816 00000100:00100000:2.0:1787381521.581362:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787381521.581368:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd19486c-5291-4823-bb9c-f3a73416a496+16:3311:x1874205065954816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787381521.581376:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00080000:0.0:1787381521.581376:0:12810:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a167f6ec800), last request at 1787381519 00000020:00000080:0.0:1787381521.581380:0:12810:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbdc38ada7ea0f7a2 00010000:00010000:2.0:1787381521.581386:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1647eb1600/0xbdc38ada7ea0fba0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbdc38ada7ea0fb99 expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787381521.581386:0:12810:0:(import.c:65:import_set_state_nolock()) ffff9a167f6ed000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787381521.581395:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:0.0:1787381521.581395:0:12810:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a167f6ec800): rc 0 00000020:00000080:0.0:1787381521.581397:0:12810:0:(genops.c:906:class_export_put()) final put ffff9a167f6ec800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1787381521.581403:0:12810:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb6ca00da3ae0 00000100:00100000:2.0:1787381521.581420:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cd19486c-5291-4823-bb9c-f3a73416a496+15:3311:x1874205065954816:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (249us total) trans 0 rc 0/0 00000100:00080000:0.0:1787381521.581421:0:12810:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787381521.581424:0:12810:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1787381521.581435:0:12810:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:1.0:1787381521.581455:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a16436a3800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00080000:0.0:1787381521.581504:0:12810:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:00000080:1.0:1787381521.581521:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a167f6ec800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00080000:0.0:1787381521.581527:0:12810:0:(import.c:65:import_set_state_nolock()) ffff9a1646072800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787381521.581538:0:12810:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787381521.581540:0:12810:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000020:00000080:1.0:1787381521.581543:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a16436a1800 for lustre-MDT0000 00000020:00000080:1.0:1787381521.581547:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a167f6ed000 for lustre-MDT0000 00000004:00080000:0.0:1787381521.581548:0:12810:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787381521.581566:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cd19486c-5291-4823-bb9c-f3a73416a496:3311:1874205065954816:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787381521.581578:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787381521.581603:0:12810:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787381521.581612:0:12810:0:(import.c:65:import_set_state_nolock()) ffff9a167f479000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1787381521.581652:0:12810:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9a166fc98000) has no exports 00010000:00010000:0.0:1787381521.582102:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787381521.582209:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787381521.582240:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542861180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1874205065954944:0@lo:9:umount.0 00010000:00010000:0.0:1787381521.582271:0:12812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381521.582273:0:12812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381521.582275:0:12812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787381521.582280:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787381521.582297:0:12811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a16413a1200/0xbdc38ada7ea0f659 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbdc38ada7ea0f660 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381521.582300:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542861c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1874205065955072:0@lo:9:umount.0 00010000:00010000:3.0:1787381521.582305:0:12811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a1200 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:3.0:1787381521.582309:0:12811:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a16413a1200/0xbdc38ada7ea0f659 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbdc38ada7ea0f660 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381521.582318:0:12811:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a16413a1200/0xbdc38ada7ea0f659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xbdc38ada7ea0f660 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381521.582320:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:3.0:1787381521.582324:0:12811:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a16413a1200/0xbdc38ada7ea0f659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xbdc38ada7ea0f660 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787381521.582330:0:12811:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787381521.582332:0:12811:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787381521.582335:0:12811:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787381521.582352:0:12811:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a16413a1200/0xbdc38ada7ea0f659 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbdc38ada7ea0f660 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381521.582354:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065954944 00000100:00100000:2.0:1787381521.582358:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065954944 00010000:00010000:3.0:1787381521.582368:0:12811:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787381521.582384:0:12811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a16413a1200/0xbdc38ada7ea0f659 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbdc38ada7ea0f660 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381521.582390:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065955072 00010000:00010000:3.0:1787381521.582391:0:12811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a16413a1200/0xbdc38ada7ea0f659 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xbdc38ada7ea0f660 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381521.582393:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065955072 00000100:00100000:3.0:1787381521.582408:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787381521.582411:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787381521.582417:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd19486c-5291-4823-bb9c-f3a73416a496:3309:1874205065955200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787381521.582417:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874205065954944:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787381521.582437:0:6590:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbdc38ada7ea0f7ef 00000100:00100000:3.0:1787381521.582441:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787381521.582443:0:6590:0:(import.c:65:import_set_state_nolock()) ffff9a167f6ef800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787381521.582464:0:6590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1787381521.582468:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065955200 00000100:00100000:3.0:1787381521.582472:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065955200 00000100:00100000:3.0:1787381521.582495:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787381521.582501:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd19486c-5291-4823-bb9c-f3a73416a496+15:3309:x1874205065955200:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787381521.582540:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787381521.582546:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874205065955072:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787381521.582558:0:6587:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbdc38ada7ea0f8d6 00000100:00080000:0.0:1787381521.582563:0:6587:0:(import.c:65:import_set_state_nolock()) ffff9a167f47c800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787381521.582584:0:6587:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1787381521.582631:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3307:x1874205065954944:12345-0@lo:9:umount.0 Request processed in 213us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381521.582638:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1787381521.582654:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787381521.582657:0:5786:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787381521.582670:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787381521.582686:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9a1646072800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787381521.582693:0:3307:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787381521.582695:0:3307:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787381521.582698:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542861180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1874205065954944:0@lo:9:umount.0 00000100:00100000:0.0:1787381521.582702:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3307:x1874205065955072:12345-0@lo:9:umount.0 Request processed in 156us (381us total) trans 0 rc 0/0 00000100:00080000:2.0:1787381521.582707:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9a167f479000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787381521.582708:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:0.0:1787381521.582722:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381521.583156:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787381521.583172:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a168216de00/0xbdc38ada7ea0f660 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbdc38ada7ea0f659 expref: 15 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381521.583188:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787381521.583267:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cd19486c-5291-4823-bb9c-f3a73416a496+14:3309:x1874205065955200:12345-0@lo:103:ldlm_bl.0 Request processed in 765us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381521.583273:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:3.0:1787381521.583298:0:12811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381521.583301:0:12811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381521.583303:0:12811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787381521.583339:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd19486c-5291-4823-bb9c-f3a73416a496:3309:1874205065955200:0@lo:103:ldlm_bl.0 00000004:00080000:2.0:1787381521.584773:0:3307:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787381521.585446:0:3307:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787381521.585456:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542861c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1874205065955072:0@lo:9:umount.0 00000020:00080000:0.0:1787381521.591393:0:12810:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9a166fc98000) has no exports 00000020:00000080:0.0:1787381521.667440:0:12810:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbdc38ada7ea0f6b4 00000020:00000080:0.0:1787381521.667456:0:12810:0:(genops.c:906:class_export_put()) final put ffff9a1674ea4000/lustre-QMT0000_UUID 00000020:01000000:0.0:1787381521.667478:0:12810:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1787381521.667859:0:2586:0:(genops.c:865:class_export_destroy()) destroying export ffff9a1674ea4000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1787381521.667882:0:12810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787381521.667891:0:12810:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787381521.667896:0:12810:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9a167b574d40) has no exports 00000020:00000080:0.0:1787381521.668483:0:12810:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbdc38ada7ea0f6ad 00000020:00000080:0.0:1787381521.668503:0:12810:0:(genops.c:906:class_export_put()) final put ffff9a1660372000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787381521.668565:0:12810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787381521.668586:0:12810:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787381521.668590:0:12810:0:(genops.c:906:class_export_put()) final put ffff9a164545e000/lustre-QMT0000_UUID 00000020:00000080:0.0:1787381521.668592:0:12810:0:(genops.c:865:class_export_destroy()) destroying export ffff9a164545e000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1787381521.668599:0:12810:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1787381521.668759:0:2586:0:(genops.c:865:class_export_destroy()) destroying export ffff9a1660372000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000001:00100000:3.0:1787381521.845484:0:7481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787381521.845504:0:7481:0:(genops.c:906:class_export_put()) final put ffff9a167f478800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1787381521.845531:0:7481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f2157c09-10df-40cb-8228-ad4822122c97 00000020:00000080:3.0:1787381521.845546:0:7481:0:(genops.c:906:class_export_put()) final put ffff9a167533a000/f2157c09-10df-40cb-8228-ad4822122c97 00000020:00000080:1.0:1787381521.845831:0:2586:0:(genops.c:865:class_export_destroy()) destroying export ffff9a167f478800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1787381521.845879:0:2586:0:(genops.c:865:class_export_destroy()) destroying export ffff9a167533a000/f2157c09-10df-40cb-8228-ad4822122c97 for lustre-OST0001 00000020:00000080:1.0:1787381521.845902:0:2586:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a167f47c800 for lustre-OST0001 00000020:00000080:1.0:1787381521.845907:0:2586:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a1675339000 for lustre-OST0001 00010000:00010000:0.0:1787381522.316461:0:12812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787381522.323647:0:12574:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 76f8c15f-81f9-4e6f-a311-d4cb5f530dfa 00000001:00080000:3.0:1787381522.323669:0:12574:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1787381522.323675:0:12574:0:(genops.c:906:class_export_put()) final put ffff9a1675360800/76f8c15f-81f9-4e6f-a311-d4cb5f530dfa 00000001:00080000:3.0:1787381522.323692:0:12574:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00100000:3.0:1787381522.323706:0:12574:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f2157c09-10df-40cb-8228-ad4822122c97 00000001:00080000:3.0:1787381522.323711:0:12574:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1787381522.323715:0:12574:0:(genops.c:906:class_export_put()) final put ffff9a166d143800/f2157c09-10df-40cb-8228-ad4822122c97 00000020:00000080:3.0:1787381522.323794:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a1675360800/76f8c15f-81f9-4e6f-a311-d4cb5f530dfa for lustre-MDT0000 00000020:00000080:3.0:1787381522.323848:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a166d143800/f2157c09-10df-40cb-8228-ad4822122c97 for lustre-MDT0000 00000020:00000080:3.0:1787381522.323877:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a1675367800 for lustre-MDT0000 00000020:00000080:3.0:1787381522.323882:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a1675360000 for lustre-MDT0000 00000001:00100000:2.0:1787381522.339849:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787381522.339861:0:6614:0:(genops.c:906:class_export_put()) final put ffff9a167f6ed800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787381522.339902:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f2157c09-10df-40cb-8228-ad4822122c97 00000020:00000080:2.0:1787381522.339904:0:6614:0:(genops.c:906:class_export_put()) final put ffff9a1658057000/f2157c09-10df-40cb-8228-ad4822122c97 00000020:00000080:1.0:1787381522.340199:0:2586:0:(genops.c:865:class_export_destroy()) destroying export ffff9a167f6ed800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1787381522.340250:0:2586:0:(genops.c:865:class_export_destroy()) destroying export ffff9a1658057000/f2157c09-10df-40cb-8228-ad4822122c97 for lustre-OST0000 00000020:00000080:1.0:1787381522.340269:0:2586:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a167f6ef800 for lustre-OST0000 00000020:00000080:1.0:1787381522.340272:0:2586:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a167533b800 for lustre-OST0000 00010000:00010000:2.0:1787381523.340419:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787381523.724754:0:12810:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a165835ad80 - data ffff9a15414b3870/ffff9a167f674c00 00000020:01000000:0.0:1787381523.724923:0:12810:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a1658a3d900 - data ffff9a1656362510/ffff9a167a7eec00 00000001:00000004:0.0:1787381523.734357:0:12810:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1787381523.826774:0:12810:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787381523.826782:0:12810:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1787381523.826822:0:12810:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787381523.826824:0:12810:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787381523.827456:0:6783:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787381523.827461:0:6783:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1787381523.827472:0:6783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1787381523.828627:0:12810:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787381523.828633:0:12810:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1787381523.828643:0:12810:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787381523.828645:0:12810:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787381523.829093:0:7769:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787381523.829097:0:7769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1787381523.829106:0:7769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1787381523.867921:0:12810:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbdc38ada7ea0f67c 00000020:00000080:2.0:1787381523.867933:0:12810:0:(genops.c:906:class_export_put()) final put ffff9a166fcaf000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787381523.869110:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a166fcaf000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787381523.869472:0:12810:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbdc38ada7ea0f691 00000020:00000080:2.0:1787381523.869480:0:12810:0:(genops.c:906:class_export_put()) final put ffff9a166fcab000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787381523.869489:0:12810:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787381523.869494:0:12810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787381523.869502:0:12810:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787381523.869505:0:12810:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9a166fc9cd40) has no exports 00000004:01000000:2.0:1787381523.869681:0:12810:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787381523.869690:0:12810:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbdc38ada7ea0f8cf 00000020:00000080:2.0:1787381523.869694:0:12810:0:(genops.c:906:class_export_put()) final put ffff9a166d142000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787381523.869698:0:12810:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787381523.869701:0:12810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787381523.869708:0:12810:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787381523.869711:0:12810:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9a1646133380) has no exports 00000020:00000080:2.0:1787381523.869717:0:12810:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbdc38ada7ea0f8c8 00000020:00000080:2.0:1787381523.869720:0:12810:0:(genops.c:906:class_export_put()) final put ffff9a167f47e000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787381523.870083:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a166fcab000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1787381523.870094:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a166d142000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787381523.870098:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a167f47e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787381523.870219:0:12810:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787381523.870224:0:12810:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787381523.870228:0:12810:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1787381523.870233:0:12810:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787381523.870245:0:12810:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787381523.870320:0:12810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787381523.870327:0:12810:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787381523.870332:0:12810:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbdc38ada7ea0f7e8 00000020:00000080:2.0:1787381523.870337:0:12810:0:(genops.c:906:class_export_put()) final put ffff9a167f70d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787381523.870736:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a167f479000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787381523.870743:0:8:0:(genops.c:906:class_export_put()) final put ffff9a166d140800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787381523.870745:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a166d140800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1787381523.870753:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787381523.870896:0:12810:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787381523.870901:0:12810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787381523.870906:0:12810:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787381523.870909:0:12810:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9a167f9b8000) has no exports 00000020:00000080:2.0:1787381523.870915:0:12810:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbdc38ada7ea0f7e1 00000020:00000080:2.0:1787381523.870919:0:12810:0:(genops.c:906:class_export_put()) final put ffff9a1646071000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1787381523.871263:0:12810:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787381523.871267:0:12810:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787381523.871269:0:12810:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1787381523.871273:0:12810:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787381523.871275:0:12810:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787381523.871301:0:12810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787381523.871306:0:12810:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787381523.871332:0:12810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787381523.871334:0:12810:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787381523.871338:0:12810:0:(genops.c:906:class_export_put()) final put ffff9a1645bdd000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787381523.871340:0:12810:0:(genops.c:865:class_export_destroy()) destroying export ffff9a1645bdd000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787381523.871344:0:12810:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787381523.871469:0:12810:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbdc38ada7ea0f698 00000020:00000080:2.0:1787381523.871474:0:12810:0:(genops.c:906:class_export_put()) final put ffff9a166fcaa800/lustre-MDD0000_UUID 00000020:01000000:2.0:1787381523.871478:0:12810:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787381523.871481:0:12810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787381523.871484:0:12810:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787381523.871486:0:12810:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9a166fc999c0) has no exports 00000020:00000080:2.0:1787381523.871507:0:12810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787381523.871510:0:12810:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787381523.871513:0:12810:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbdc38ada7ea0f69f 00000020:00000080:2.0:1787381523.871524:0:12810:0:(genops.c:906:class_export_put()) final put ffff9a166fca9000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787381523.871531:0:12810:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a16659a7000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1787381523.871534:0:12810:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a16659a7000 3 00000020:01000004:2.0:1787381523.871537:0:12810:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a16659a7000 from lustre-MDT0000 00000020:00000080:2.0:1787381523.871551:0:12810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787381523.871554:0:12810:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787381523.871556:0:12810:0:(genops.c:906:class_export_put()) final put ffff9a166fcad800/lustre-MDT0000_UUID 00000020:00000080:2.0:1787381523.871558:0:12810:0:(genops.c:865:class_export_destroy()) destroying export ffff9a166fcad800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787381523.871564:0:12810:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1787381523.871588:0:12810:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1787381523.871591:0:12810:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787381523.871593:0:12810:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787381523.871595:0:12810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787381523.871597:0:12810:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787381523.871603:0:12810:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9a16461c9800 cd19486c-5291-4823-bb9c-f3a73416a496 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787381523.871608:0:12810:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9a1646134d40) has exports, disconnecting them 00000020:00080000:2.0:1787381523.871612:0:12810:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9a16461c9800), last request at 1787381297 00000020:00000080:2.0:1787381523.871624:0:12810:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbdc38ada7ea0f63d 00000020:00010000:2.0:1787381523.871627:0:12810:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a16461c9800: total 4 00000100:00080000:2.0:1787381523.871631:0:12810:0:(import.c:65:import_set_state_nolock()) ffff9a16461cc000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787381523.871647:0:12810:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a16461c9800): rc 0 00000020:00080000:2.0:1787381523.871651:0:12810:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9a1646134d40) has no exports 00000100:00100000:2.0:1787381523.871697:0:5784:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9a16461b7000:5784] 1 exiting: rc = 0 00000100:00100000:2.0:1787381523.871886:0:5783:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9a16460fd400:5783] 0 exiting: rc = 1 00000020:00000080:1.0:1787381523.872106:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a167f70d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787381523.872118:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a1646071000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787381523.872123:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a1646072800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787381523.872127:0:8:0:(genops.c:906:class_export_put()) final put ffff9a166fca8000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787381523.872129:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a166fca8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1787381523.872132:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787381523.872199:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a166fcaa800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1787381523.872203:0:8:0:(genops.c:906:class_export_put()) final put ffff9a166fca8800/lustre-MDD0000_UUID 00000020:00000080:1.0:1787381523.872204:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a166fca8800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1787381523.872207:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1787381523.872338:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a166fca9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:2.0:1787381523.872402:0:5778:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a16461c9800: total 0 00010000:00010000:2.0:1787381523.872424:0:5778:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a16461c9800, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1787381523.872454:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1647eb1000/0xbdc38ada7ea0fb84 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbdc38ada7ea0fb7d expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381523.872469:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1681732400/0xbdc38ada7ea0fb92 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbdc38ada7ea0fb8b expref: 8 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381523.872495:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a168216ce00/0xbdc38ada7ea0f755 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbdc38ada7ea0f74e expref: 7 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381523.872508:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1640030800/0xbdc38ada7ea0f993 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbdc38ada7ea0f98c expref: 6 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381523.872520:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1640030c00/0xbdc38ada7ea0f93f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbdc38ada7ea0f938 expref: 5 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381523.872530:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1640031400/0xbdc38ada7ea0f94d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbdc38ada7ea0f946 expref: 4 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381523.872541:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1640031000/0xbdc38ada7ea0f95b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbdc38ada7ea0f954 expref: 3 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381523.872550:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a168216dc00/0xbdc38ada7ea0f969 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xbdc38ada7ea0f962 expref: 2 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381523.872560:0:5778:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a16461c9800, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1787381523.872573:0:5778:0:(genops.c:906:class_export_put()) final put ffff9a16461c9800/cd19486c-5291-4823-bb9c-f3a73416a496 00010000:00010000:2.0:1787381523.872592:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381523.872594:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381523.872596:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787381523.872628:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a16461c9800/cd19486c-5291-4823-bb9c-f3a73416a496 for MGS 00000020:00000080:1.0:1787381523.872659:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a16461cc000 for MGS 00000100:00100000:1.0:1787381523.873132:0:5785:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9a16461b6000:5785] 2 exiting: rc = 0 00000100:00100000:2.0:1787381523.873262:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873270:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873276:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873282:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873288:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873295:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873301:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873314:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873321:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873326:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873332:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873338:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873343:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873349:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873355:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873360:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873366:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873372:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873377:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873383:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873389:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873395:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873408:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873414:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873420:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873426:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873431:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873436:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873442:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873447:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873453:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873459:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873464:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873469:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873474:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873479:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873484:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873490:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873495:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873500:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873504:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873509:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873522:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873527:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873533:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873538:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873543:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873549:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873553:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873558:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873563:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873568:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873572:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873577:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873582:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873587:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873592:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873598:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873605:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873611:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873616:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873622:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873627:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787381523.873632:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1787381523.873992:0:12810:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787381523.873996:0:12810:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1787381523.875048:0:12810:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a167a3bb600 - data ffff9a166a2dbd80/ffff9a167fb87400 00000020:01000000:2.0:1787381523.875156:0:12810:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a1646e9c060 - data ffff9a1656305510/ffff9a164830d800 00000020:00000080:2.0:1787381523.875583:0:12810:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbdc38ada7ea0f621 00000020:00000080:2.0:1787381523.875590:0:12810:0:(genops.c:906:class_export_put()) final put ffff9a164b76d000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787381523.875606:0:12810:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a16659a7000 from MGS, refs=2 00000020:01000004:2.0:1787381523.875610:0:12810:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a16659a7000 2 00000020:01000004:2.0:1787381523.875614:0:12810:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a16659a7000 from MGS 00000020:00000080:2.0:1787381523.875633:0:12810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787381523.875640:0:12810:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1787381523.875642:0:12810:0:(genops.c:906:class_export_put()) final put ffff9a164b76e800/MGS 00000020:00000080:2.0:1787381523.875644:0:12810:0:(genops.c:865:class_export_destroy()) destroying export ffff9a164b76e800/MGS for MGS 00000020:01000000:2.0:1787381523.875658:0:12810:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1787381523.875708:0:12810:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1787381523.875712:0:12810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787381523.875717:0:12810:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787381523.875724:0:12810:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9a1645bdb000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787381523.875729:0:12810:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff9a166fc9b380) has exports, disconnecting them 00000020:00080000:2.0:1787381523.875733:0:12810:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9a1645bdb000), last request at 1787381297 00000020:00000080:2.0:1787381523.875737:0:12810:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbdc38ada7ea0f6ec 00000020:00080000:2.0:1787381523.875747:0:12810:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a1645bdb000): rc 0 00000020:00000080:2.0:1787381523.875751:0:12810:0:(genops.c:906:class_export_put()) final put ffff9a1645bdb000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787381523.876444:0:2586:0:(genops.c:865:class_export_destroy()) destroying export ffff9a164b76d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787381523.876455:0:2586:0:(genops.c:865:class_export_destroy()) destroying export ffff9a1645bdb000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787381523.881136:0:12810:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787381523.881146:0:12810:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787381523.881151:0:12810:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787381523.881157:0:12810:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787381523.881302:0:12810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787381523.881311:0:12810:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787381523.881318:0:12810:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a16659a7000 1 00000020:00000080:0.0:1787381523.881325:0:12810:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbdc38ada7ea0f613 00000020:00000080:0.0:1787381523.881333:0:12810:0:(genops.c:906:class_export_put()) final put ffff9a164b76b800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1787381523.881338:0:12810:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787381523.881342:0:12810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787381523.881346:0:12810:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787381523.881350:0:12810:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9a16483d19c0) has no exports 00000020:00000080:1.0:1787381523.881415:0:2586:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a166fcae000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787381523.881421:0:2586:0:(genops.c:906:class_export_put()) final put ffff9a166fcae800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1787381523.881424:0:2586:0:(genops.c:865:class_export_destroy()) destroying export ffff9a166fcae800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1787381523.881431:0:2586:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1787381523.881491:0:2586:0:(genops.c:865:class_export_destroy()) destroying export ffff9a164b76b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787381523.918874:0:12810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787381523.918889:0:12810:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1787381523.918895:0:12810:0:(genops.c:906:class_export_put()) final put ffff9a16659a5800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787381523.918899:0:12810:0:(genops.c:865:class_export_destroy()) destroying export ffff9a16659a5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787381523.918926:0:12810:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1787381523.919213:0:12810:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a16659a4000 00000020:01000000:0.0:1787381523.919235:0:12810:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1787381523.919240:0:12810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787381523.919244:0:12810:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787381523.919248:0:12810:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9a16461319c0) has no exports 00000100:00100000:0.0:1787381523.919318:0:11324:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9a1675096e00:11324] 4 exiting: rc = 0 00000100:00100000:0.0:1787381523.919428:0:8469:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9a167514b800:8469] 3 exiting: rc = 0 00000100:00100000:1.0:1787381523.921486:0:5792:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9a164501c400:5792] 2 exiting: rc = 0 00000100:00100000:3.0:1787381523.921929:0:5790:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9a164501d800:5790] 0 exiting: rc = 1 00000100:00100000:3.0:1787381523.921997:0:5791:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9a164501cc00:5791] 1 exiting: rc = 0 00000100:00100000:0.0:1787381523.922324:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922332:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922338:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922344:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922349:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922354:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922359:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922364:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922370:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922375:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922381:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922386:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922392:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922397:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922402:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922407:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922413:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922418:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922423:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922429:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922435:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922440:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922446:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922451:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922457:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922463:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922482:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922488:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922494:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922499:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922504:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922510:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922515:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922521:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922527:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922533:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922539:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922545:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922551:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922558:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922563:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922570:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922576:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922582:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922587:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922593:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922598:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922603:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922609:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922615:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922620:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922625:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922631:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922637:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922642:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922648:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922653:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922658:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922663:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922668:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922673:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922686:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922691:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.922706:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.925640:0:5793:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9a164501c000:5793] 0 exiting: rc = 1 00000100:00100000:1.0:1787381523.925917:0:5794:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9a164501d600:5794] 1 exiting: rc = 0 00000100:00100000:0.0:1787381523.931074:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931086:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931093:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931099:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931105:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931112:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931118:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931124:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931130:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931136:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931142:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931149:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931156:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931162:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931167:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931172:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931177:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931183:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931190:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931195:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931199:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931205:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931211:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931216:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931220:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931225:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931231:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931237:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931242:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931247:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931252:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931274:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931280:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931285:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931291:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931295:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931300:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931306:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931311:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931316:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931323:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931329:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931335:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931341:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931347:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931352:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931357:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931363:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931368:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931373:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931378:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931384:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931390:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931395:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931400:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931404:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931409:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931441:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931447:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931452:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931457:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931463:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931469:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.931475:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932086:0:5795:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9a164501ca00:5795] 0 exiting: rc = 1 00000100:00100000:1.0:1787381523.932184:0:5796:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9a164501d200:5796] 1 exiting: rc = 0 00000100:00100000:1.0:1787381523.932238:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932246:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932253:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932272:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932280:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932286:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932293:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932299:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932308:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932328:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932334:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932340:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932346:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932353:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932358:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932365:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932370:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932376:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932381:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932387:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932393:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932414:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932421:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932427:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932434:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932440:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932446:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932452:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932458:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932464:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932469:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932475:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932480:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932503:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932510:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932515:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932521:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932527:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932538:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932544:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932550:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932555:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932561:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932567:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932573:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932593:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932599:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932606:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932611:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932616:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932622:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932627:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932633:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932640:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932645:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932651:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932656:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932674:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932679:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932684:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932689:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932694:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932699:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.932704:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787381523.948857:0:5797:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9a164501de00:5797] 0 exiting: rc = 1 00000100:00100000:0.0:1787381523.949127:0:5798:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9a164501ce00:5798] 1 exiting: rc = 0 00000100:00100000:1.0:1787381523.949280:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949289:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949294:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949300:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949306:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949311:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949316:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949321:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949325:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949339:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949344:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949349:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949354:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949359:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949365:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949370:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949375:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949380:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949385:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949390:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949396:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949401:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949407:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949413:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949418:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949424:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949430:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949435:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949441:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949446:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949452:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949456:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949461:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949467:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949472:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949477:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949483:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949488:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949493:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949498:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949502:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949507:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949511:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949516:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949530:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949537:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949542:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949547:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949552:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949556:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949561:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949566:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949572:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949577:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949582:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949588:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949592:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949597:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949602:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949607:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949612:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949617:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949622:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949628:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.949966:0:5799:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9a164501dc00:5799] 0 exiting: rc = 1 00000100:00100000:0.0:1787381523.950102:0:5800:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9a16461c3800:5800] 1 exiting: rc = 0 00000100:00100000:1.0:1787381523.950408:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950414:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950420:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950425:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950431:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950436:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950442:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950447:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950451:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950457:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950462:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950467:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950471:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950476:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950491:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950496:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950500:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950505:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950510:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950515:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950520:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950524:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950529:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950535:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950540:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950545:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950550:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950556:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950561:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950565:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950570:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950575:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950579:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950585:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950591:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950596:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950601:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950606:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950612:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950616:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950621:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950627:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950632:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950636:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950641:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950645:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950650:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950655:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950659:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950671:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950676:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950681:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950686:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950691:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950697:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950702:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950707:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950712:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950717:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950721:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950725:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950730:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950735:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.950740:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.951098:0:5801:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9a164369ba00:5801] 0 exiting: rc = 1 00000100:00100000:1.0:1787381523.951730:0:5802:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9a164369a800:5802] 1 exiting: rc = 0 00000100:00100000:1.0:1787381523.951783:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.951790:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.951795:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.951800:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.951806:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.951823:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.951828:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.951833:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.951838:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.951842:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.951848:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.951852:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.951857:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.951862:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.951867:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.951872:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.951877:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.951883:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.951898:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.951902:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.951907:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.951911:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.951940:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.951945:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.951950:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.951955:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.951960:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.951965:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.951970:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.951974:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.951980:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.951985:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.951990:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.951994:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.952000:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.952037:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.952042:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.952047:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.952052:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.952057:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.952062:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.952067:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.952072:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.952078:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.952082:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.952086:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.952091:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.952096:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.952101:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.952106:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.952111:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.952115:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.952120:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.952134:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.952139:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.952144:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.952149:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.952153:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.952157:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.952162:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.952167:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.952172:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.952177:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.952182:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.952658:0:5804:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9a16435e8c00:5804] 1 exiting: rc = 0 00000100:00100000:1.0:1787381523.952834:0:5805:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9a16435e9c00:5805] 2 exiting: rc = 0 00000100:00100000:0.0:1787381523.953080:0:5803:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9a16435e8400:5803] 0 exiting: rc = 1 00000100:00100000:1.0:1787381523.953179:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953185:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953191:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953196:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953203:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953223:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953230:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953236:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953241:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953246:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953251:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953257:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953262:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953267:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953272:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953277:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953282:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953415:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953422:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953427:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953433:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953440:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953458:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953463:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953467:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953473:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953479:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953484:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953490:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953510:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953517:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953523:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953528:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953533:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953539:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953544:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953549:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953555:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953561:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953566:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953571:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953576:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953581:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953586:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953591:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953596:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953601:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953606:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953612:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953617:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953622:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953628:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953633:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953651:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953657:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953662:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953667:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953678:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953684:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953689:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953694:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953700:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953705:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381523.953710:0:12810:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787381523.963244:0:12810:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787381523.963256:0:12810:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1787381523.963262:0:12810:0:(genops.c:906:class_export_put()) final put ffff9a1646074800/MDS_uuid 00000020:00000080:0.0:1787381523.963266:0:12810:0:(genops.c:865:class_export_destroy()) destroying export ffff9a1646074800/MDS_uuid for MDS 00000020:01000000:0.0:1787381523.963272:0:12810:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1787381523.963401:0:12810:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1787381524.364944:0:12811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787381524.821720:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1874205065955456:0@lo:400:kworker.0 00000400:00000100:1.0:1787381524.821773:0:3310:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874205065955456 offset 0 length 224: 4 00000100:00100000:1.0:1787381524.821954:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787381524.821961:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1874205065955584:0@lo:400:kworker.0 00000400:00000100:1.0:1787381524.822063:0:3310:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874205065955584 offset 0 length 224: 4 00000100:00100000:3.0:1787381524.822609:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd19486c-5291-4823-bb9c-f3a73416a496:3309:1874205065955328:0@lo:400:kworker.0 00000400:00000100:3.0:1787381524.822634:0:3309:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874205065955328 offset 0 length 224: 4 00010000:00010000:1.0:1787381525.388392:0:12812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381526.414602:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787381526.592472:0:12965:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787381526.612218:0:12965:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1787381526.612278:0:12965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a168216da00/0xbdc38ada7ea0f954 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f95b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381526.612302:0:12965:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a168216da00/0xbdc38ada7ea0f954 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f95b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381526.612310:0:12965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a168216da00/0xbdc38ada7ea0f954 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xbdc38ada7ea0f95b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381526.612317:0:12965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9a168216da00/0xbdc38ada7ea0f954 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xbdc38ada7ea0f95b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381526.612341:0:12965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787381526.612347:0:12965:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1787381526.612352:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787381526.612361:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a168216da00/0xbdc38ada7ea0f954 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xbdc38ada7ea0f95b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787381526.612370:0:12965:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:0.0:1787381526.612372:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a168216da00 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:0.0:1787381526.612377:0:5778:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a168216da00/0xbdc38ada7ea0f954 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xbdc38ada7ea0f95b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381526.612383:0:12965:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a167a6f4000 x1874205065955456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787381540 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1787381526.612391:0:5778:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a168216da00/0xbdc38ada7ea0f954 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xbdc38ada7ea0f95b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787381526.612400:0:5778:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a168216da00/0xbdc38ada7ea0f954 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xbdc38ada7ea0f95b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787381526.612409:0:5778:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787381526.612416:0:5778:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787381526.612420:0:5778:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:2.0:1787381526.612429:0:12965:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787381526.612436:0:12965:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787381526.612453:0:12965:0:(import.c:65:import_set_state_nolock()) ffff9a164545b800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1787381526.612456:0:5778:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a168216da00/0xbdc38ada7ea0f954 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xbdc38ada7ea0f95b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381526.612466:0:5778:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787381526.612490:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a168216da00/0xbdc38ada7ea0f954 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xbdc38ada7ea0f95b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381526.612508:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a168216da00/0xbdc38ada7ea0f954 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xbdc38ada7ea0f95b expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381526.612519:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381526.612521:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381526.612522:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787381526.612537:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542860000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065955712:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787381526.612636:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1874205065955840:0@lo:39:umount.0 00000100:00100000:3.0:1787381526.612669:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1874205065955456:0@lo:400:kworker.0 00000100:00100000:0.0:1787381526.612686:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381526.612888:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065955712 00000100:00100000:2.0:1787381526.612895:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065955712 00000100:00100000:2.0:1787381526.612982:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787381526.612989:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542861f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3308:x1874205065955712:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787381526.612996:0:5777:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787381526 with bad export cookie 13673925564658939453 00000400:00000100:1.0:1787381526.614203:0:3307:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874205065955840 offset 0 length 224: 4 00000100:00100000:3.0:1787381526.626752:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542861f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3308:x1874205065955712:12345-0@lo:103:ldlm_bl.0 Request processed in 13753us (14059us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787381526.626769:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1787381526.627178:0:3308:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.122@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787381526.627185:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9a1646070000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1787381526.627189:0:3308:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1787381526.633245:0:3308:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.122@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1787381526.633283:0:3308:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787381526.633293:0:3308:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a167a6f7800 x1874205065955328/t0(0) o400->MGC192.168.203.122@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787381540 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381526.633363:0:3308:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a1542860000 x1874205065955712/t0(0) o103->MGC192.168.203.122@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787381542 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787381526.633373:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787381526.633376:0:3308:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787381526.633377:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787381526.633380:0:3308:0:(import.c:65:import_set_state_nolock()) ffff9a1646070000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787381526.633385:0:3308:0:(import.c:510:import_select_connection()) MGC192.168.203.122@tcp: connect to NID 0@lo last attempt 155 00000100:00080000:0.0:1787381526.633392:0:3308:0:(import.c:624:import_select_connection()) MGC192.168.203.122@tcp: import ffff9a1646070000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:1.0:1787381526.633532:0:3308:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a167a6f4000 x1874205065955968/t0(0) o250->MGC192.168.203.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787381526.633569:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542860000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cd19486c-5291-4823-bb9c-f3a73416a496:3308:1874205065955712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787381526.633645:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cd19486c-5291-4823-bb9c-f3a73416a496:3309:1874205065955328:0@lo:400:kworker.0 00000100:00100000:2.0:1787381526.633704:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cd19486c-5291-4823-bb9c-f3a73416a496:3307:1874205065955968:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:2.0:1787381526.633751:0:3307:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874205065955968 offset 0 length 520: 4 00010000:00010000:3.0:1787381527.440423:0:12811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381528.460303:0:12812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381529.487065:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787381529.936321:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) cd19486c-5291-4823-bb9c-f3a73416a496->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787381529.936331:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) cd19486c-5291-4823-bb9c-f3a73416a496->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787381529.936432:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1874205065956096:0@lo:400:kworker.0 00000400:00000100:3.0:1787381529.936488:0:3309:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874205065956096 offset 0 length 224: 4 00010000:00010000:0.0:1787381530.508531:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787381530.956101:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) cd19486c-5291-4823-bb9c-f3a73416a496->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787381530.956109:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) cd19486c-5291-4823-bb9c-f3a73416a496->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787381530.956224:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787381530.956242:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542863800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1874205065956224:0@lo:400:kworker.0 00000400:00000100:1.0:1787381530.956291:0:3311:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874205065956224 offset 0 length 224: 4 00010000:00010000:1.0:1787381531.532211:0:12811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381532.556652:0:12812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381533.586422:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381534.606192:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381535.628793:0:12811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787381536.076107:0:2586:0:(pinger.c:229:ptlrpc_pinger_process_import()) cd19486c-5291-4823-bb9c-f3a73416a496->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787381536.076118:0:2586:0:(pinger.c:247:ptlrpc_pinger_process_import()) cd19486c-5291-4823-bb9c-f3a73416a496->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787381536.076241:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787381536.076258:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542860a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1874205065956352:0@lo:400:kworker.0 00000100:00100000:1.0:1787381536.076277:0:3307:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787381526/real 1787381526] req@ffff9a167a6f4000 x1874205065955968/t0(0) o250->MGC192.168.203.122@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787381536 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000400:00000100:3.0:1787381536.076321:0:3310:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874205065956352 offset 0 length 224: 4 00000100:00100000:1.0:1787381536.076332:0:3307:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a167a6f4000 x1874205065955968/t0(0) o250->MGC192.168.203.122@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787381536 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381536.076342:0:3307:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787381526/real 1787381526] req@ffff9a167a6c8e00 x1874205065955840/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787381536 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381536.076354:0:3307:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a167a6c8e00 x1874205065955840/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787381536 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787381536.076366:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9a1646070000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787381536.076379:0:3307:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1787381536.076383:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cd19486c-5291-4823-bb9c-f3a73416a496:3307:1874205065955968:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:1.0:1787381536.076388:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9a164545b800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787381536.076407:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1874205065955840:0@lo:39:umount.0 00000100:00080000:2.0:1787381536.076421:0:2586:0:(pinger.c:229:ptlrpc_pinger_process_import()) cd19486c-5291-4823-bb9c-f3a73416a496->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787381536.076426:0:2586:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1787381536.076430:0:2586:0:(import.c:65:import_set_state_nolock()) ffff9a1646070000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787381536.076436:0:2586:0:(import.c:510:import_select_connection()) MGC192.168.203.122@tcp: connect to NID 0@lo last attempt 384 00000100:00080000:2.0:1787381536.076441:0:2586:0:(import.c:589:import_select_connection()) MGC192.168.203.122@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787381536.076447:0:2586:0:(import.c:624:import_select_connection()) MGC192.168.203.122@tcp: import ffff9a1646070000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1787381536.076465:0:2586:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a167a6c8e00 x1874205065956480/t0(0) o250->MGC192.168.203.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787381536.076525:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cd19486c-5291-4823-bb9c-f3a73416a496:3307:1874205065956480:0@lo:250:kworker.0 00000400:00000100:1.0:1787381536.076547:0:3307:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874205065956480 offset 0 length 520: 4 00000100:00080000:3.0:1787381536.076611:0:12965:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787381536.076615:0:12965:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787381536.076620:0:12965:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787381536.078447:0:12965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1681732600/0xbdc38ada7ea0f962 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f969 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381536.078466:0:12965:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1681732600/0xbdc38ada7ea0f962 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f969 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381536.078475:0:12965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1681732600/0xbdc38ada7ea0f962 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xbdc38ada7ea0f969 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381536.078481:0:12965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9a1681732600/0xbdc38ada7ea0f962 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xbdc38ada7ea0f969 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381536.078508:0:12965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787381536.078515:0:12965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1681733c00/0xbdc38ada7ea0fb8b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0fb92 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381536.078521:0:12965:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1681733c00/0xbdc38ada7ea0fb8b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0fb92 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381536.078526:0:12965:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1681733c00/0xbdc38ada7ea0fb8b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbdc38ada7ea0fb92 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381536.078530:0:12965:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9a1681733c00/0xbdc38ada7ea0fb8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbdc38ada7ea0fb92 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381536.078562:0:12965:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787381536.078566:0:12965:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1787381536.078591:0:12965:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1787381536.078595:0:12965:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1787381536.078599:0:12965:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787381536.078604:0:12965:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787381536.078608:0:12965:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9a16483d4d40) has no exports 00000020:00080000:3.0:1787381536.078630:0:12965:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9a16483d4d40) has no exports 00010000:00010000:2.0:1787381536.079853:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787381536.079866:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a1681732600/0xbdc38ada7ea0f962 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xbdc38ada7ea0f969 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381536.079877:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681732600 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:2.0:1787381536.079895:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a1681732600/0xbdc38ada7ea0f962 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xbdc38ada7ea0f969 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381536.079905:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a1681732600/0xbdc38ada7ea0f962 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xbdc38ada7ea0f969 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787381536.079912:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a1681732600/0xbdc38ada7ea0f962 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xbdc38ada7ea0f969 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787381536.079918:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787381536.079920:0:5779:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1787381536.079923:0:5779:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1787381536.079938:0:5779:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a1646070000 00010000:00010000:2.0:1787381536.079942:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a1681732600/0xbdc38ada7ea0f962 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xbdc38ada7ea0f969 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381536.079949:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a1681732600/0xbdc38ada7ea0f962 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xbdc38ada7ea0f969 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381536.079965:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787381536.079969:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a1681733c00/0xbdc38ada7ea0fb8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbdc38ada7ea0fb92 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381536.079974:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681733c00 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:2.0:1787381536.079977:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a1681733c00/0xbdc38ada7ea0fb8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbdc38ada7ea0fb92 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381536.079984:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a1681733c00/0xbdc38ada7ea0fb8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xbdc38ada7ea0fb92 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787381536.079991:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a1681733c00/0xbdc38ada7ea0fb8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xbdc38ada7ea0fb92 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787381536.080049:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787381536.080053:0:5779:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787381536.080055:0:5779:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787381536.080062:0:5779:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a1646070000 00010000:00010000:2.0:1787381536.080066:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a1681733c00/0xbdc38ada7ea0fb8b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbdc38ada7ea0fb92 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381536.080072:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a1681733c00/0xbdc38ada7ea0fb8b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbdc38ada7ea0fb92 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381536.080083:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381536.080085:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381536.080088:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787381536.084234:0:12965:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a167a3bb540 - data ffff9a166a2db798/ffff9a167fb87000 00000020:01000000:3.0:1787381536.084355:0:12965:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a167a813e40 - data ffff9a166a08bbd0/ffff9a1676fe4400 00010000:00010000:1.0:1787381536.084708:0:12812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1787381536.095825:0:12965:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787381536.162490:0:12965:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbdc38ada7ea0f771 00000020:00000080:2.0:1787381536.162500:0:12965:0:(genops.c:906:class_export_put()) final put ffff9a167f70c800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1787381536.162516:0:12965:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a1646496800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1787381536.162520:0:12965:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a1646496800 2 00000020:01000004:2.0:1787381536.162523:0:12965:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a1646496800 from lustre-OST0000 00000020:00000080:2.0:1787381536.162552:0:12965:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787381536.162561:0:12965:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1787381536.162563:0:12965:0:(genops.c:906:class_export_put()) final put ffff9a167f47f000/lustre-OST0000_UUID 00000020:00000080:2.0:1787381536.162566:0:12965:0:(genops.c:865:class_export_destroy()) destroying export ffff9a167f47f000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1787381536.162573:0:12965:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1787381536.162623:0:12965:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1787381536.162627:0:12965:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787381536.162631:0:12965:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787381536.162635:0:12965:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787381536.162641:0:12965:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9a1645bd9800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787381536.162647:0:12965:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff9a167f9bcd40) has exports, disconnecting them 00000020:00000080:1.0:1787381536.162927:0:2586:0:(genops.c:865:class_export_destroy()) destroying export ffff9a167f70c800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00080000:2.0:1787381536.163176:0:12965:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9a1645bd9800), last request at 1787381315 00000020:00000080:2.0:1787381536.163181:0:12965:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbdc38ada7ea0f79b 00000020:00080000:2.0:1787381536.163192:0:12965:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a1645bd9800): rc 0 00000020:00000080:2.0:1787381536.163198:0:12965:0:(genops.c:906:class_export_put()) final put ffff9a1645bd9800/lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1787381536.166067:0:12965:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1787381536.166075:0:12965:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787381536.166079:0:12965:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787381536.166085:0:12965:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787381536.168153:0:2586:0:(genops.c:865:class_export_destroy()) destroying export ffff9a1645bd9800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787381536.180865:0:12965:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787381536.180879:0:12965:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1787381536.180898:0:12965:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a1646496800 1 00000020:00000080:3.0:1787381536.180905:0:12965:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbdc38ada7ea0f72b 00000020:00000080:3.0:1787381536.180913:0:12965:0:(genops.c:906:class_export_put()) final put ffff9a166d07b800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1787381536.184593:0:2586:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a164545b800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787381536.184608:0:2586:0:(genops.c:906:class_export_put()) final put ffff9a1645bdf800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787381536.184611:0:2586:0:(genops.c:865:class_export_destroy()) destroying export ffff9a1645bdf800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787381536.184619:0:2586:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1787381536.188778:0:12965:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1787381536.188791:0:12965:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787381536.188800:0:12965:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787381536.188806:0:12965:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9a167b570000) has no exports 00000020:00000080:1.0:1787381536.188870:0:2586:0:(genops.c:865:class_export_destroy()) destroying export ffff9a166d07b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787381536.238176:0:12965:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787381536.238202:0:12965:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1787381536.238207:0:12965:0:(genops.c:906:class_export_put()) final put ffff9a1646493800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1787381536.238211:0:12965:0:(genops.c:865:class_export_destroy()) destroying export ffff9a1646493800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1787381536.238220:0:12965:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1787381536.238363:0:12965:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a1646494800 00000020:02000400:1.0:1787381536.238422:0:12965:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1787381536.653233:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381537.676276:0:12811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381538.703811:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787381539.201760:0:13118:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787381539.233390:0:13118:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1787381539.233464:0:13118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1681733600/0xbdc38ada7ea0f938 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f93f expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381539.233479:0:13118:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1681733600/0xbdc38ada7ea0f938 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f93f expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381539.233488:0:13118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1681733600/0xbdc38ada7ea0f938 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbdc38ada7ea0f93f expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381539.233496:0:13118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9a1681733600/0xbdc38ada7ea0f938 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xbdc38ada7ea0f93f expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381539.233531:0:13118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787381539.233536:0:13118:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787381539.233566:0:13118:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787381539.233578:0:13118:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a167a6f5500 x1874205065955584/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787381540 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381539.233592:0:13118:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a1542863480 x1874205065956096/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787381545 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381539.233603:0:13118:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a1542863800 x1874205065956224/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787381546 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381539.233631:0:13118:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a1542860a80 x1874205065956352/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787381552 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381539.233638:0:13118:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787381539.233643:0:13118:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787381539.233665:0:13118:0:(import.c:65:import_set_state_nolock()) ffff9a1675362000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1787381539.235196:0:12812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787381539.235209:0:12812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a1681733600/0xbdc38ada7ea0f938 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbdc38ada7ea0f93f expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381539.235221:0:12812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681733600 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:2.0:1787381539.235225:0:12812:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a1681733600/0xbdc38ada7ea0f938 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xbdc38ada7ea0f93f expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381539.235235:0:12812:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a1681733600/0xbdc38ada7ea0f938 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbdc38ada7ea0f93f expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787381539.235243:0:12812:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a1681733600/0xbdc38ada7ea0f938 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbdc38ada7ea0f93f expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787381539.235248:0:12812:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787381539.235250:0:12812:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787381539.235253:0:12812:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787381539.235268:0:12812:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a1646070000 00010000:00010000:2.0:1787381539.235272:0:12812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a1681733600/0xbdc38ada7ea0f938 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbdc38ada7ea0f93f expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381539.235289:0:12812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a1681733600/0xbdc38ada7ea0f938 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbdc38ada7ea0f93f expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381539.235301:0:12812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787381539.235310:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542862d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1874205065956608:0@lo:39:umount.0 00010000:00010000:2.0:1787381539.235315:0:12812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381539.235316:0:12812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787381539.235339:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542863800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1874205065956224:0@lo:400:kworker.0 00000400:00000100:1.0:1787381539.235361:0:3307:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874205065956608 offset 0 length 224: 4 00000100:00100000:3.0:1787381539.240111:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542860a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1874205065956352:0@lo:400:kworker.0 00000100:00100000:3.0:1787381539.240128:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1874205065955584:0@lo:400:kworker.0 00000100:00100000:3.0:1787381539.240175:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1874205065956096:0@lo:400:kworker.0 00010000:00010000:0.0:1787381539.724956:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381540.749083:0:12811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787381541.200810:0:2586:0:(pinger.c:229:ptlrpc_pinger_process_import()) cd19486c-5291-4823-bb9c-f3a73416a496->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787381541.200819:0:2586:0:(pinger.c:247:ptlrpc_pinger_process_import()) cd19486c-5291-4823-bb9c-f3a73416a496->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1787381541.772568:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381542.796331:0:12812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381543.820975:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381544.844153:0:12811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381545.871740:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787381546.317640:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) cd19486c-5291-4823-bb9c-f3a73416a496->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787381546.317649:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) cd19486c-5291-4823-bb9c-f3a73416a496->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1787381546.892520:0:12812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381547.916307:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381548.940473:0:12811:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787381549.452099:0:3307:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787381539/real 1787381539] req@ffff9a1542862d80 x1874205065956608/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787381549 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381549.452132:0:3307:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a1542862d80 x1874205065956608/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787381549 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787381549.452151:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9a1675362000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787381549.452210:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542862d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1874205065956608:0@lo:39:umount.0 00000100:00080000:0.0:1787381549.452267:0:13118:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787381549.452272:0:13118:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787381549.452276:0:13118:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787381549.453580:0:13118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1681732c00/0xbdc38ada7ea0f946 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0f94d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381549.453720:0:13118:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1681732c00/0xbdc38ada7ea0f946 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0f94d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381549.453727:0:13118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1681732c00/0xbdc38ada7ea0f946 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbdc38ada7ea0f94d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381549.453831:0:13118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9a1681732c00/0xbdc38ada7ea0f946 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xbdc38ada7ea0f94d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381549.453912:0:13118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787381549.453921:0:13118:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1681732e00/0xbdc38ada7ea0fb7d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea0fb84 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381549.453930:0:13118:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1681732e00/0xbdc38ada7ea0fb7d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea0fb84 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381549.453948:0:13118:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1681732e00/0xbdc38ada7ea0fb7d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbdc38ada7ea0fb84 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381549.453955:0:13118:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9a1681732e00/0xbdc38ada7ea0fb7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xbdc38ada7ea0fb84 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381549.453983:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787381549.453990:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a1681732c00/0xbdc38ada7ea0f946 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbdc38ada7ea0f94d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381549.453997:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681732c00 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:1.0:1787381549.454001:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a1681732c00/0xbdc38ada7ea0f946 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xbdc38ada7ea0f94d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381549.454115:0:13118:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787381549.454121:0:13118:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1787381549.454145:0:13118:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1787381549.454149:0:13118:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1787381549.454154:0:13118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787381549.454159:0:13118:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787381549.454162:0:13118:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9a167b5719c0) has no exports 00000020:00080000:0.0:1787381549.454186:0:13118:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9a167b5719c0) has no exports 00010000:00010000:1.0:1787381549.454549:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a1681732c00/0xbdc38ada7ea0f946 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xbdc38ada7ea0f94d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787381549.454557:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a1681732c00/0xbdc38ada7ea0f946 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xbdc38ada7ea0f94d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787381549.454563:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787381549.454565:0:5779:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1787381549.454568:0:5779:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1787381549.454581:0:5779:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a1646070000 00010000:00010000:1.0:1787381549.454585:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a1681732c00/0xbdc38ada7ea0f946 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbdc38ada7ea0f94d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381549.454602:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a1681732c00/0xbdc38ada7ea0f946 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xbdc38ada7ea0f94d expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381549.454616:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787381549.454619:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a1681732e00/0xbdc38ada7ea0fb7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbdc38ada7ea0fb84 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381549.454626:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1681732e00 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:1.0:1787381549.454629:0:5779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a1681732e00/0xbdc38ada7ea0fb7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xbdc38ada7ea0fb84 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381549.454646:0:5779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a1681732e00/0xbdc38ada7ea0fb7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xbdc38ada7ea0fb84 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787381549.454653:0:5779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a1681732e00/0xbdc38ada7ea0fb7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xbdc38ada7ea0fb84 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787381549.454783:0:5779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787381549.454786:0:5779:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787381549.454788:0:5779:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787381549.454794:0:5779:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a1646070000 00010000:00010000:1.0:1787381549.454797:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a1681732e00/0xbdc38ada7ea0fb7d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xbdc38ada7ea0fb84 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381549.454804:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a1681732e00/0xbdc38ada7ea0fb7d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xbdc38ada7ea0fb84 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381549.454817:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381549.454819:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787381549.460211:0:13118:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a167a3bbcc0 - data ffff9a165630cca8/ffff9a1675355c00 00010000:00010000:2.0:1787381549.460297:0:12812:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787381549.460367:0:13118:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a1646e7f660 - data ffff9a16563a2bd0/ffff9a167ab4a800 00010000:00010000:1.0:1787381549.462405:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1787381549.474671:0:13118:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787381549.520165:0:13118:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbdc38ada7ea0f83c 00000020:00000080:2.0:1787381549.520176:0:13118:0:(genops.c:906:class_export_put()) final put ffff9a1675066000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1787381549.520194:0:13118:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a16436a3000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1787381549.520199:0:13118:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a16436a3000 2 00000020:01000004:2.0:1787381549.520211:0:13118:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a16436a3000 from lustre-OST0001 00000020:00000080:2.0:1787381549.520234:0:13118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787381549.520244:0:13118:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1787381549.520247:0:13118:0:(genops.c:906:class_export_put()) final put ffff9a166f6ab000/lustre-OST0001_UUID 00000020:00000080:2.0:1787381549.520250:0:13118:0:(genops.c:865:class_export_destroy()) destroying export ffff9a166f6ab000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1787381549.520257:0:13118:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:1.0:1787381549.520405:0:2586:0:(genops.c:865:class_export_destroy()) destroying export ffff9a1675066000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:2.0:1787381549.520629:0:13118:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import cd19486c-5291-4823-bb9c-f3a73416a496->MGS 00010000:00010000:2.0:1787381549.520658:0:13118:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a16413a0600/0xbdc38ada7ea0f74e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbdc38ada7ea0f755 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787381549.520671:0:13118:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a16413a0600/0xbdc38ada7ea0f74e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbdc38ada7ea0f755 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787381549.520678:0:13118:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1787381549.520681:0:13118:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1787381549.520693:0:13118:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1787381549.520800:0:13118:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a1646070000 00010000:00010000:2.0:1787381549.520805:0:13118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a16413a0600/0xbdc38ada7ea0f74e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbdc38ada7ea0f755 expref: -99 pid: 6584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381549.520822:0:13118:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a1541388400/0xbdc38ada7ea0f98c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xbdc38ada7ea0f993 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787381549.520829:0:13118:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a1541388400/0xbdc38ada7ea0f98c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xbdc38ada7ea0f993 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787381549.520835:0:13118:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787381549.520837:0:13118:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1787381549.520838:0:13118:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1787381549.520848:0:13118:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a1646070000 00010000:00010000:2.0:1787381549.520851:0:13118:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a1541388400/0xbdc38ada7ea0f98c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xbdc38ada7ea0f993 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787381549.520866:0:13118:0:(import.c:65:import_set_state_nolock()) ffff9a1646070000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1787381549.520869:0:13118:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787381549.520872:0:13118:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787381549.520873:0:13118:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787381549.520878:0:13118:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787381549.520888:0:13118:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a167a6c8e00 x1874205065956480/t0(0) o250->MGC192.168.203.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787381551 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787381549.520910:0:13118:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787381549.520912:0:13118:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:1.0:1787381549.520975:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cd19486c-5291-4823-bb9c-f3a73416a496:3307:1874205065956480:0@lo:250:kworker.0 10000000:01000000:2.0:1787381549.521349:0:13118:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787381549.521357:0:13118:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbdc38ada7ea0f62f 00000020:00000080:2.0:1787381549.521361:0:13118:0:(genops.c:906:class_export_put()) final put ffff9a1646075000/cd19486c-5291-4823-bb9c-f3a73416a496 00000020:01000000:2.0:1787381549.521375:0:13118:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.203.122@tcp (flags='') 00000020:00000080:2.0:1787381549.521381:0:13118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787381549.521391:0:13118:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.122@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787381549.521395:0:13118:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9a1646130000) has no exports 00000020:00000080:1.0:1787381549.521496:0:2586:0:(genops.c:865:class_export_destroy()) destroying export ffff9a1646075000/cd19486c-5291-4823-bb9c-f3a73416a496 for MGC192.168.203.122@tcp 10000000:01000000:3.0:1787381549.521609:0:5787:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1787381549.521854:0:13118:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.122@tcp: client import never connected 00000100:00080000:2.0:1787381549.521857:0:13118:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1787381549.521860:0:13118:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787381549.521862:0:13118:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1787381549.521864:0:13118:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787381549.521903:0:13118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787381549.521910:0:13118:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.122@tcp (uuid cd19486c-5291-4823-bb9c-f3a73416a496) 00000020:01000000:2.0:1787381549.521915:0:13118:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1787381549.521918:0:13118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787381549.521921:0:13118:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787381549.521926:0:13118:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9a16436a6800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787381549.521931:0:13118:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff9a16483d0000) has exports, disconnecting them 00000020:00080000:2.0:1787381549.521935:0:13118:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9a16436a6800), last request at 1787381334 00000020:00000080:2.0:1787381549.521939:0:13118:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbdc38ada7ea0f866 00000020:00080000:2.0:1787381549.521948:0:13118:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a16436a6800): rc 0 00000020:00000080:2.0:1787381549.521951:0:13118:0:(genops.c:906:class_export_put()) final put ffff9a16436a6800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1787381549.522290:0:2586:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a1646070000 for MGC192.168.203.122@tcp 00000020:00000080:1.0:1787381549.522297:0:2586:0:(genops.c:906:class_export_put()) final put ffff9a1646070800/cd19486c-5291-4823-bb9c-f3a73416a496 00000020:00000080:1.0:1787381549.522299:0:2586:0:(genops.c:865:class_export_destroy()) destroying export ffff9a1646070800/cd19486c-5291-4823-bb9c-f3a73416a496 for MGC192.168.203.122@tcp 00000020:01000000:1.0:1787381549.522304:0:2586:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.122@tcp (cd19486c-5291-4823-bb9c-f3a73416a496) 00000020:00000080:1.0:1787381549.522524:0:2586:0:(genops.c:865:class_export_destroy()) destroying export ffff9a16436a6800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1787381549.523990:0:13118:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1787381549.523997:0:13118:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787381549.524000:0:13118:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787381549.524033:0:13118:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787381549.524120:0:2586:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a1675362000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1787381549.525039:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1787381549.525231:0:12811:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1787381549.525351:0:12812:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:1.0:1787381549.525537:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:1.0:1787381549.525815:0:5774:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9a1646427800:5774] 1 exiting: rc = 0 00000100:00100000:1.0:1787381549.527095:0:5773:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9a1646426800:5773] 0 exiting: rc = 1 00000100:00100000:3.0:1787381549.527272:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.527520:0:5777:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9a1660b7ea00:5777] 2 exiting: rc = 0 00000100:00100000:3.0:1787381549.527575:0:5776:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9a1660b7fe00:5776] 1 exiting: rc = 0 00000100:00100000:1.0:1787381549.527928:0:5775:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9a1660b7f800:5775] 0 exiting: rc = 1 00000100:00100000:3.0:1787381549.528611:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528620:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528626:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528646:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528653:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528659:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528665:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528670:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528676:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528681:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528687:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528692:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528706:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528714:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528720:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528726:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528732:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528737:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528741:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528746:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528750:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528754:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528759:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528764:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528769:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528787:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528792:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528798:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528803:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528809:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528815:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528820:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528825:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528830:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528835:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528840:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528846:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528851:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528855:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528861:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528866:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528871:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528876:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528881:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528886:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528892:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528897:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528903:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528907:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528913:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528918:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528925:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528930:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528935:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528940:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528945:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528951:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528956:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528962:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528967:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528980:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528985:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528990:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.528996:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787381549.530679:0:13118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787381549.530690:0:13118:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1787381549.530695:0:13118:0:(genops.c:906:class_export_put()) final put ffff9a1675367000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1787381549.530793:0:13118:0:(genops.c:865:class_export_destroy()) destroying export ffff9a1675367000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1787381549.530801:0:13118:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1787381549.530847:0:13118:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a16436a3000 1 00000020:00000080:3.0:1787381549.530853:0:13118:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xbdc38ada7ea0f80b 00000020:00000080:3.0:1787381549.530859:0:13118:0:(genops.c:906:class_export_put()) final put ffff9a1660376000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1787381549.530880:0:13118:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1787381549.530884:0:13118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787381549.530889:0:13118:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787381549.530892:0:13118:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9a167f9b99c0) has no exports 00000020:00000080:1.0:1787381549.531293:0:2586:0:(genops.c:865:class_export_destroy()) destroying export ffff9a1660376000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1787381549.562626:0:13118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787381549.562751:0:13118:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1787381549.562757:0:13118:0:(genops.c:906:class_export_put()) final put ffff9a16436a7000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1787381549.562762:0:13118:0:(genops.c:865:class_export_destroy()) destroying export ffff9a16436a7000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1787381549.562775:0:13118:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1787381549.562958:0:13118:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a16436a5800 00000020:01000000:1.0:1787381549.562979:0:13118:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1787381549.562983:0:13118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787381549.562987:0:13118:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787381549.562991:0:13118:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9a16483d3380) has no exports 00000020:00000080:1.0:1787381549.563052:0:13118:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787381549.563058:0:13118:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1787381549.563061:0:13118:0:(genops.c:906:class_export_put()) final put ffff9a166d07e000/OSS_uuid 00000020:00000080:1.0:1787381549.563063:0:13118:0:(genops.c:865:class_export_destroy()) destroying export ffff9a166d07e000/OSS_uuid for OSS 00000020:01000000:1.0:1787381549.563067:0:13118:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1787381549.563899:0:5786:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1787381549.564062:0:7779:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9a167f6a0800:7779] 3 exiting: rc = 0 00000100:00100000:2.0:1787381549.564114:0:6588:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9a1675179400:6588] 1 exiting: rc = 0 00000100:00100000:2.0:1787381549.564269:0:6590:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9a1674e85600:6590] 2 exiting: rc = 0 00000100:00100000:0.0:1787381549.568120:0:6587:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9a1675178e00:6587] 0 exiting: rc = 1 00000100:00100000:3.0:1787381549.574098:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574109:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574117:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574122:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574127:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574133:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574138:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574144:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574150:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574156:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574161:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574165:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574170:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574176:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574181:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574185:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574190:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574194:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574212:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574217:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574222:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574227:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574233:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574238:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574246:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574251:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574255:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574259:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574265:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574270:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574275:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574279:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574284:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574290:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574295:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574300:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574305:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574309:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574313:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574318:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574323:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574328:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574332:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574337:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574341:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574347:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574352:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574357:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574362:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574367:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574373:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574377:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574381:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574393:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574398:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574402:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574407:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574412:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574416:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574422:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574427:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574434:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574439:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.574443:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.575391:0:6591:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9a1675178c00:6591] 0 exiting: rc = 1 00000100:00100000:1.0:1787381549.575477:0:6592:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9a1674e84e00:6592] 1 exiting: rc = 0 00000100:00100000:3.0:1787381549.575580:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575600:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575605:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575610:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575616:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575621:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575626:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575646:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575663:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575669:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575674:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575680:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575685:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575690:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575705:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575710:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575715:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575721:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575726:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575731:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575736:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575741:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575745:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575751:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575767:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575772:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575777:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575782:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575786:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575791:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575796:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575800:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575805:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575809:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575814:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575819:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575823:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575827:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575832:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575836:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575841:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575846:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575851:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575856:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575860:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575865:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575869:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575874:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575879:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575884:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575889:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575894:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575899:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575904:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575910:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575914:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575919:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575923:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575928:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575940:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575946:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575950:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575955:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.575960:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.576761:0:6593:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9a166f7d1600:6593] 0 exiting: rc = 1 00000100:00100000:1.0:1787381549.577109:0:6594:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9a1642d12600:6594] 1 exiting: rc = 0 00000100:00100000:2.0:1787381549.579527:0:6595:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9a168173fe00:6595] 2 exiting: rc = 0 00000100:00100000:3.0:1787381549.579829:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.579837:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.579842:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.579848:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.579854:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.579876:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.579883:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.579888:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.579894:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.579900:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.579905:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.579910:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.579915:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.579922:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.579928:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.579933:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.579939:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.579945:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.579950:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.579956:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.579961:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.579968:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.579973:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.579979:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.579984:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.579989:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.579995:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.580000:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.580032:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.580062:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.580070:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.580075:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.580081:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.580087:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.580093:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.580098:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.580104:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.580109:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.580114:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.580120:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.580126:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.580131:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.580136:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.580142:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.580148:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.580154:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.580163:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.580169:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.580175:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.580181:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.580186:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.580192:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.580198:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.580204:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.580210:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.580224:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.580230:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.580235:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.580240:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.580245:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.580251:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.580264:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.580271:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.580278:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.598871:0:6596:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9a168173f400:6596] 0 exiting: rc = 1 00000100:00100000:3.0:1787381549.599118:0:6597:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9a16659b8600:6597] 1 exiting: rc = 0 00000100:00100000:1.0:1787381549.599225:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599232:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599239:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599244:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599248:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599253:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599258:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599263:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599268:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599273:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599291:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599302:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599307:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599311:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599317:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599322:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599327:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599332:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599338:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599343:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599348:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599353:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599357:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599363:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599383:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599389:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599394:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599399:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599404:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599409:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599414:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599419:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599424:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599429:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599435:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599440:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599445:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599450:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599455:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599460:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599475:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599484:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599490:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599495:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599503:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599516:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599522:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599527:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599532:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599537:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599542:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599546:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599551:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599556:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599561:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599571:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599577:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599581:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599586:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599591:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599596:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599601:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599606:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.599611:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787381549.600516:0:6598:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9a168173e000:6598] 0 exiting: rc = 1 00000100:00100000:3.0:1787381549.600588:0:6599:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9a167a7ad400:6599] 1 exiting: rc = 0 00000100:00100000:1.0:1787381549.600945:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.600953:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.600964:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.600984:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.600990:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.600996:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601054:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601062:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601067:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601073:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601079:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601085:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601090:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601095:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601101:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601122:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601136:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601141:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601147:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601153:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601159:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601165:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601171:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601176:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601182:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601188:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601194:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601214:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601222:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601229:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601236:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601242:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601248:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601254:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601260:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601265:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601271:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601276:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601283:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601301:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601308:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601314:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601320:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601327:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601333:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601339:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601345:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601350:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601356:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601360:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601367:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601388:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601393:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601398:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601403:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601409:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601414:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601419:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601425:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601430:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601435:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601440:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601446:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787381549.601458:0:13118:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1787381549.630868:0:13118:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1787381567.991964:0:13740:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787381574.878593:0:14153:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787381574.878599:0:14153:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787381574.878713:0:14153:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a15411ca800 00000020:01000004:2.0:1787381574.878728:0:14153:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787381574.878736:0:14153:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787381574.878750:0:14153:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9a167b5719c0) 00000020:00000080:2.0:1787381574.878764:0:14153:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787381574.899286:0:14153:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787381574.903343:0:14153:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1787381574.905243:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 339: rc = 0 00100000:10000000:2.0:1787381574.905752:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 339: rc = 0 00100000:10000000:2.0:1787381574.906293:0:14153:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787381574.906378:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 339: rc = 0 00100000:10000000:2.0:1787381574.906571:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 339: rc = 0 00100000:10000000:2.0:1787381574.906750:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 339: rc = 0 00100000:10000000:2.0:1787381574.906994:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 339: rc = 0 00100000:10000000:2.0:1787381574.907536:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 341: rc = 0 00100000:10000000:2.0:1787381574.909781:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 643: rc = 0 00100000:10000000:2.0:1787381574.910072:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 643: rc = 0 00100000:10000000:2.0:1787381574.910797:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 478: rc = 0 00100000:10000000:0.0:1787381574.911276:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 478: rc = 0 00100000:10000000:0.0:1787381574.911540:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 478: rc = 0 00100000:10000000:0.0:1787381574.911788:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 478: rc = 0 00100000:10000000:0.0:1787381574.912067:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 478: rc = 0 00100000:10000000:0.0:1787381574.912325:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 478: rc = 0 00100000:10000000:0.0:1787381574.912586:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 478: rc = 0 00100000:10000000:0.0:1787381574.912838:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 478: rc = 0 00100000:10000000:0.0:1787381574.913123:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 478: rc = 0 00100000:10000000:0.0:1787381574.913372:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 478: rc = 0 00100000:10000000:0.0:1787381574.913635:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 478: rc = 0 00100000:10000000:0.0:1787381574.913884:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 478: rc = 0 00100000:10000000:0.0:1787381574.914337:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 656: rc = 0 00100000:10000000:1.0:1787381574.917505:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 656: rc = 0 00100000:10000000:1.0:1787381574.917814:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 656: rc = 0 00100000:10000000:1.0:1787381574.918126:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 656: rc = 0 00100000:10000000:1.0:1787381574.918386:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 656: rc = 0 00100000:10000000:1.0:1787381574.918652:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 656: rc = 0 00100000:10000000:1.0:1787381574.918905:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 656: rc = 0 00100000:10000000:1.0:1787381574.919186:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 656: rc = 0 00100000:10000000:1.0:1787381574.919427:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 656: rc = 0 00100000:10000000:1.0:1787381574.919695:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 656: rc = 0 00100000:10000000:1.0:1787381574.919938:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 656: rc = 0 00100000:10000000:1.0:1787381574.920230:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 656: rc = 0 00100000:10000000:1.0:1787381574.927083:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 656: rc = 0 00100000:10000000:1.0:1787381574.927521:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 656: rc = 0 00100000:10000000:1.0:1787381574.927770:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 656: rc = 0 00100000:10000000:1.0:1787381574.930454:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 656: rc = 0 00100000:10000000:1.0:1787381574.930770:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 656: rc = 0 00100000:10000000:1.0:1787381574.934311:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 656: rc = 0 00100000:10000000:1.0:1787381574.935800:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 656: rc = 0 00100000:10000000:1.0:1787381574.937219:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 656: rc = 0 00100000:10000000:1.0:1787381574.937904:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 656: rc = 0 00100000:10000000:1.0:1787381574.938239:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 656: rc = 0 00100000:10000000:1.0:1787381574.938522:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 656: rc = 0 00100000:10000000:1.0:1787381574.938780:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 656: rc = 0 00100000:10000000:1.0:1787381574.939077:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 656: rc = 0 00100000:10000000:1.0:1787381574.939314:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 656: rc = 0 00100000:10000000:1.0:1787381574.939560:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 656: rc = 0 00100000:10000000:1.0:1787381574.939782:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 656: rc = 0 00100000:10000000:1.0:1787381574.940061:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 656: rc = 0 00100000:10000000:1.0:1787381574.940289:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 656: rc = 0 00100000:10000000:1.0:1787381574.941072:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 656: rc = 0 00100000:10000000:1.0:1787381574.941363:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 656: rc = 0 00100000:10000000:1.0:1787381574.941787:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 492: rc = 0 00100000:10000000:1.0:1787381574.943270:0:14153:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1787381574.943436:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 644: rc = 0 00100000:10000000:1.0:1787381574.943664:0:14153:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1787381574.943730:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 644: rc = 0 00100000:10000000:1.0:1787381574.944391:0:14153:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1787381574.944548:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 644: rc = 0 00100000:10000000:1.0:1787381574.945207:0:14153:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1787381574.945279:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 515: rc = 0 00100000:10000000:1.0:1787381574.945536:0:14153:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1787381574.945614:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 515: rc = 0 00100000:10000000:1.0:1787381574.946060:0:14153:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1787381574.946141:0:14153:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 515: rc = 0 00000020:00000080:1.0:1787381574.947053:0:14153:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1787381574.947062:0:14153:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787381574.947073:0:14153:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbdc38ada7ea10930 00000020:01000004:1.0:1787381574.947081:0:14153:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1787381574.947086:0:14153:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1787381574.947091:0:14153:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a15411ca800 from MGS 00000020:01000004:1.0:1787381574.947095:0:14153:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1787381574.947105:0:14153:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9a167f9b99c0) 00000020:00000080:1.0:1787381574.947116:0:14153:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1787381574.947172:0:14153:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a15411ca800 from MGS, refs=2 00080000:01000000:1.0:1787381574.947176:0:14153:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787381574.947182:0:14153:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbdc38ada7ea1093e 00000100:00100000:1.0:1787381574.947277:0:14153:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1787381574.947397:0:14153:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1787381574.947403:0:14153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787381574.949427:0:14153:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787381574.949441:0:14153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787381574.951212:0:14153:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787381574.951434:0:14153:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787381574.951441:0:14153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787381574.952100:0:14153:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787381574.952108:0:14153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787381574.953603:0:14153:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787381574.953613:0:14153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787381574.961808:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381574.961814:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381574.961816:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381574.962269:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381574.962272:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381574.962273:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381574.964512:0:14153:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787381574.970446:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787381574.989546:0:14153:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1787381574.989564:0:14153:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787381574.989567:0:14153:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1787381575.001293:0:14163:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787381575.002352:0:14153:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787381575.002488:0:14153:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787381575.002986:0:14153:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787381575.003331:0:14153:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787381575.003493:0:14153:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787381575.003499:0:14153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787381575.004470:0:14153:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787381575.004478:0:14153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787381575.004806:0:14153:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787381575.004812:0:14153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787381575.008040:0:14153:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787381575.008067:0:14153:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.122@tcp' 00000020:01000004:3.0:1787381575.008069:0:14153:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787381575.008116:0:14153:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.122@tcp (typ=mgc) 00000020:00000080:3.0:1787381575.008128:0:14153:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.122@tcp (ffff9a16483d0000) 00000020:00000080:3.0:1787381575.008144:0:14153:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787381575.008214:0:14153:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a1675361800@MGC192.168.203.122@tcp: add connection 192.168.203.122@tcp at head 00010000:00010000:3.0:1787381575.008365:0:14153:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.122@tcp-0 is initialized 00000040:01000000:3.0:1787381575.008370:0:14153:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.122@tcp ctxt 1 is initialized 00000100:00080000:2.0:1787381575.011366:0:14167:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1787381575.013285:0:14169:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787381575.014273:0:14153:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.122@tcp (uuid 05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73) 00000020:00000080:2.0:1787381575.014297:0:14153:0:(genops.c:1406:class_connect()) connect: client 05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73, cookie 0xbdc38ada7ea1094c 00000100:00080000:2.0:1787381575.014315:0:14153:0:(import.c:510:import_select_connection()) MGC192.168.203.122@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787381575.014322:0:14153:0:(import.c:624:import_select_connection()) MGC192.168.203.122@tcp: import ffff9a1675361800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1787381575.014354:0:14153:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a167a6c8700 x1874205065956736/t0(0) o250->MGC192.168.203.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787381575.014385:0:14153:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73->MGS 00000020:01000004:2.0:1787381575.014408:0:14153:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787381575.014413:0:14153:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787381575.014426:0:14153:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9a167b573380) 00000020:00000080:2.0:1787381575.014438:0:14153:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787381575.014593:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:3307:1874205065956736:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787381575.014665:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381575.014730:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065956736 00000100:00100000:0.0:1787381575.014737:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065956736 00000100:00100000:0.0:1787381575.014762:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787381575.014770:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164342c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3307:x1874205065956736:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1787381575.014791:0:14164:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73@0@lo t0 exp 0000000000000000 cur 433 last 0 00000020:00000080:0.0:1787381575.014811:0:14164:0:(genops.c:1406:class_connect()) connect: client 05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73, cookie 0xbdc38ada7ea1095a 00000100:00080000:0.0:1787381575.014940:0:14164:0:(import.c:65:import_set_state_nolock()) ffff9a1645b4e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787381575.014990:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164342c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+5:3307:x1874205065956736:12345-0@lo:250:mount.lustre.0 Request processed in 219us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381575.014998:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787381575.015100:0:3307:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.122@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787381575.015108:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.122@tcp: connect to target with instance 0 00000100:00080000:0.0:1787381575.015117:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.122@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787381575.015121:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787381575.015125:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9a1675361800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787381575.015127:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787381575.015135:0:3307:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787381575.015139:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:3307:1874205065956736:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787381575.032864:0:14153:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787381575.033070:0:14153:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787381575.033077:0:14153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787381575.044729:0:14153:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787381575.044749:0:14153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787381575.045293:0:14153:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787381575.045301:0:14153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787381575.045984:0:14153:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787381575.046293:0:14153:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787381575.046299:0:14153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787381575.054257:0:14153:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787381575.054308:0:14153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787381575.111828:0:14153:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787381575.112330:0:14153:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787381575.112338:0:14153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787381575.113697:0:14153:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787381575.113709:0:14153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1787381575.114453:0:14153:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787381575.114613:0:14153:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787381575.114619:0:14153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787381575.115283:0:14153:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787381575.115291:0:14153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1787381575.115764:0:14153:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787381575.115887:0:14153:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787381575.116061:0:14153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1787381575.116641:0:14153:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787381575.116649:0:14153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787381575.117557:0:14153:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787381575.117692:0:14153:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787381575.117698:0:14153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787381575.118435:0:14153:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787381575.118444:0:14153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787381575.158625:0:14153:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787381575.158810:0:14153:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787381575.158816:0:14153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787381575.166842:0:14153:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787381575.167443:0:14153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787381575.168526:0:14153:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787381575.168537:0:14153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787381575.169604:0:14153:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787381575.169635:0:14153:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1787381575.169642:0:14153:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.122@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787381575.169783:0:14153:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.122@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787381575.169827:0:14153:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.122@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1787381575.169831:0:14153:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787381575.169833:0:14153:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787381575.169834:0:14153:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787381575.169835:0:14153:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787381575.169836:0:14153:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787381575.169838:0:14153:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787381575.169839:0:14153:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787381575.169841:0:14153:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787381575.169843:0:14153:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787381575.169844:0:14153:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787381575.169846:0:14153:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1787381575.169849:0:14153:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787381575.169850:0:14153:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787381575.169851:0:14153:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787381575.169852:0:14153:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787381575.169853:0:14153:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787381575.169854:0:14153:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787381575.169855:0:14153:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787381575.169856:0:14153:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787381575.169857:0:14153:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787381575.169858:0:14153:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787381575.169884:0:14153:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787381575.170221:0:14153:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14153:1874205065956864:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787381575.170299:0:14153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381575.170389:0:14153:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1652067cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787381575.170483:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065956864 00000100:00100000:1.0:1787381575.170491:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065956864 00000100:00100000:1.0:1787381575.170569:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787381575.170579:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164342e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+5:14153:x1874205065956864:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787381575.170623:0:14166:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787381575.170626:0:14166:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787381575.170629:0:14166:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1787381575.171789:0:14187:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787381575.172555:0:14166:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1787381575.180672:0:14188:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1787381575.180681:0:14188:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1787381575.180684:0:14188:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1787381575.180720:0:14188:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1787381575.181049:0:14166:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787381575.181059:0:14166:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787381575.187094:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164342e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+5:14153:x1874205065956864:12345-0@lo:253:mount.lustre.0 Request processed in 16508us (16785us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381575.187109:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787381575.187191:0:14153:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14153:1874205065956864:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787381575.187206:0:14153:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787381575.187209:0:14153:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787381575.187211:0:14153:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787381575.187212:0:14153:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787381575.187228:0:14153:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787381575.187229:0:14153:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787381575.187230:0:14153:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787381575.187232:0:14153:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787381575.187233:0:14153:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787381575.187235:0:14153:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787381575.187236:0:14153:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787381575.187256:0:14153:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a15411ca800 from lustre-MDT0000 10000000:01000000:3.0:1787381575.187285:0:14153:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787381575.187287:0:14153:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787381575.187291:0:14153:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a16483d0000 10000000:01000000:3.0:1787381575.187295:0:14153:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787381575.187303:0:14153:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9a16483d0000 from 1 10000000:01000000:3.0:1787381575.187306:0:14153:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787381575.187343:0:14153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1647eb0800/0xbdc38ada7ea10961 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381575.187354:0:14153:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a1647eb0800/0xbdc38ada7ea10961 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381575.187363:0:14153:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a1647eb0800/0xbdc38ada7ea10961 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381575.187381:0:14153:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14153:1874205065956992:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787381575.187416:0:14153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381575.187443:0:14153:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1652067e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787381575.187755:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065956992 00000100:00100000:0.0:1787381575.187762:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065956992 00000100:00100000:0.0:1787381575.187853:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787381575.187869:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164342f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+5:14153:x1874205065956992:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787381575.187882:0:14165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381575.187909:0:14165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a16460c9600/0xbdc38ada7ea10968 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea10961 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381575.187932:0:14165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a16460c9600/0xbdc38ada7ea10968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea10961 expref: 6 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381575.187943:0:14165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a16460c9600/0xbdc38ada7ea10968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea10961 expref: 6 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381575.187952:0:14165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16460c9600, rc 0) 00000100:00100000:0.0:1787381575.187996:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164342f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+6:14153:x1874205065956992:12345-0@lo:101:mount.lustre.0 Request processed in 129us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381575.188024:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787381575.188100:0:14153:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14153:1874205065956992:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787381575.188114:0:14153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a1647eb0800/0xbdc38ada7ea10961 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10968 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381575.188123:0:14153:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a1647eb0800/0xbdc38ada7ea10961 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea10968 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381575.188177:0:14153:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14153:1874205065957120:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787381575.188202:0:14153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381575.200651:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065957120 00000100:00100000:2.0:1787381575.200665:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065957120 00000100:00100000:2.0:1787381575.200729:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787381575.200739:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164342c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+6:14153:x1874205065957120:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787381575.201185:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164342c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+6:14153:x1874205065957120:12345-0@lo:501:mount.lustre.0 Request processed in 446us (12981us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787381575.201193:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787381575.204550:0:14153:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1652067e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787381575.204595:0:14153:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14153:1874205065957120:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787381575.204650:0:14153:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787381575.204666:0:14153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1647eb0800/0xbdc38ada7ea10961 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10968 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381575.204697:0:14153:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a1647eb0800/0xbdc38ada7ea10961 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10968 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787381575.204707:0:14153:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a15411ca800 10000000:01000000:1.0:1787381575.204713:0:14153:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787381575.204718:0:14153:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a15411ca800 10000000:01000000:1.0:1787381575.204721:0:14153:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787381575.204724:0:14153:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9a15411ca800 from 1 10000000:01000000:1.0:1787381575.204726:0:14153:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787381575.204765:0:14153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1541388e00/0xbdc38ada7ea1096f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381575.204773:0:14153:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a1541388e00/0xbdc38ada7ea1096f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381575.204783:0:14153:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a1541388e00/0xbdc38ada7ea1096f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381575.204803:0:14153:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14153:1874205065957248:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787381575.204888:0:14153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381575.204920:0:14153:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167a7d60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787381575.204940:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065957248 00000100:00100000:1.0:1787381575.204946:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065957248 00000100:00100000:1.0:1787381575.205024:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787381575.205035:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164342d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+6:14153:x1874205065957248:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787381575.205047:0:14165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381575.205060:0:14165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1541389800/0xbdc38ada7ea10976 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea1096f expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381575.205094:0:14165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1541389800/0xbdc38ada7ea10976 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea1096f expref: 7 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381575.205104:0:14165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1541389800/0xbdc38ada7ea10976 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea1096f expref: 7 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381575.205113:0:14165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541389800, rc 0) 00000100:00100000:1.0:1787381575.205161:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164342d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+7:14153:x1874205065957248:12345-0@lo:101:mount.lustre.0 Request processed in 127us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381575.205169:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787381575.205189:0:14153:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14153:1874205065957248:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787381575.205201:0:14153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a1541388e00/0xbdc38ada7ea1096f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10976 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381575.205210:0:14153:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a1541388e00/0xbdc38ada7ea1096f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea10976 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787381575.205223:0:14153:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787381575.205226:0:14153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1541388e00/0xbdc38ada7ea1096f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10976 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381575.205232:0:14153:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a1541388e00/0xbdc38ada7ea1096f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10976 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787381575.205238:0:14153:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787381575.205241:0:14153:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787381575.205246:0:14153:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a15411ca800 10000000:01000000:3.0:1787381575.205248:0:14153:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787381575.205251:0:14153:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787381575.205253:0:14153:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787381575.205266:0:14153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1647eb0400/0xbdc38ada7ea1097d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381575.205274:0:14153:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a1647eb0400/0xbdc38ada7ea1097d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381575.205293:0:14153:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a1647eb0400/0xbdc38ada7ea1097d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381575.205306:0:14153:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14153:1874205065957376:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787381575.205333:0:14153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381575.205359:0:14153:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1652067000 going to sleep for 11 seconds 00000100:00100000:2.0:1787381575.205404:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065957376 00000100:00100000:2.0:1787381575.205410:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065957376 00000100:00100000:2.0:1787381575.205444:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787381575.205468:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164342d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+7:14153:x1874205065957376:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787381575.205476:0:14164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381575.205491:0:14164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a16413a1600/0xbdc38ada7ea10984 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea1097d expref: -99 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381575.205506:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a16413a1600/0xbdc38ada7ea10984 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea1097d expref: 8 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381575.205514:0:14164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a16413a1600/0xbdc38ada7ea10984 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea1097d expref: 8 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381575.205521:0:14164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16413a1600, rc 0) 00000100:00100000:2.0:1787381575.205558:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164342d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+8:14153:x1874205065957376:12345-0@lo:101:mount.lustre.0 Request processed in 99us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381575.205564:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787381575.205578:0:14153:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14153:1874205065957376:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787381575.205588:0:14153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a1647eb0400/0xbdc38ada7ea1097d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10984 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381575.205596:0:14153:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a1647eb0400/0xbdc38ada7ea1097d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea10984 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381575.205647:0:14153:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14153:1874205065957504:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787381575.205674:0:14153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381575.205697:0:14153:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1652067000 going to sleep for 11 seconds 00000100:00100000:2.0:1787381575.205794:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065957504 00000100:00100000:2.0:1787381575.205799:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065957504 00000100:00100000:2.0:1787381575.205823:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787381575.205829:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164342f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+8:14153:x1874205065957504:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787381575.206350:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164342f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+9:14153:x1874205065957504:12345-0@lo:501:mount.lustre.0 Request processed in 520us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381575.206369:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787381575.209097:0:14153:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14153:1874205065957504:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787381575.209165:0:14153:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14153:1874205065957632:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787381575.209246:0:14153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381575.209287:0:14153:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1652067000 going to sleep for 11 seconds 00000100:00100000:1.0:1787381575.209388:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065957632 00000100:00100000:1.0:1787381575.209395:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065957632 00000100:00100000:1.0:1787381575.209472:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787381575.209482:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164342cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+9:14153:x1874205065957632:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787381575.209849:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164342cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+9:14153:x1874205065957632:12345-0@lo:503:mount.lustre.0 Request processed in 368us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381575.210113:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787381575.210307:0:14153:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14153:1874205065957632:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787381575.210767:0:14189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14189:1874205065957760:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787381575.210814:0:14189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381575.210969:0:14189:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167a7d6180 going to sleep for 11 seconds 00000100:00100000:3.0:1787381575.211039:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065957760 00000100:00100000:3.0:1787381575.211045:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065957760 00000100:00100000:3.0:1787381575.211098:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787381575.211109:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a396450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+9:14189:x1874205065957760:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787381575.212100:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a396450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+9:14189:x1874205065957760:12345-0@lo:502:llog_process_th.0 Request processed in 989us (1279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381575.212112:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787381575.215112:0:14189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14189:1874205065957760:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787381575.215193:0:14189:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787381575.215218:0:14189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787381575.215221:0:14189:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787381575.215226:0:14189:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787381575.215229:0:14189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787381575.215243:0:14189:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9a167f9bcd40) 00000020:00000080:1.0:1787381575.215262:0:14189:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787381575.215267:0:14189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787381575.215353:0:14189:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787381575.215585:0:14189:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbdc38ada7ea10992 00000020:00000080:1.0:1787381575.215809:0:14189:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787381575.215814:0:14189:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787381575.215819:0:14189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787381575.215820:0:14189:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787381575.218807:0:14189:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787381575.218839:0:14189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787381575.218841:0:14189:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787381575.218847:0:14189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787381575.218985:0:14189:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9a167f9b8000) 00000020:00000080:1.0:1787381575.219029:0:14189:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787381575.219036:0:14189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787381575.219038:0:14189:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787381575.219041:0:14189:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787381575.219048:0:14189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787381575.219127:0:14189:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a15411ca800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787381575.219281:0:14189:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9a167f9bb380) 00000020:00000080:1.0:1787381575.219291:0:14189:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787381575.219341:0:14189:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787381575.219347:0:14189:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbdc38ada7ea109a7 00000020:00000080:1.0:1787381575.219820:0:14189:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787381575.221752:0:14189:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787381575.221766:0:14189:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xbdc38ada7ea109ae 00080000:01000000:1.0:1787381575.221774:0:14189:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787381575.221778:0:14189:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbdc38ada7ea109b5 00010000:00010000:3.0:1787381575.336755:0:14189:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1787381575.337267:0:14189:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1787381575.337902:0:14189:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787381575.338473:0:14189:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9a16483d3380) 00000020:00000080:3.0:1787381575.338492:0:14189:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787381575.338551:0:14189:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787381575.338558:0:14189:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbdc38ada7ea109c3 00000020:00000080:2.0:1787381575.342037:0:14189:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787381575.357716:0:14189:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xbdc38ada7ea109ca 00000020:00000080:3.0:1787381575.358184:0:14189:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787381575.358195:0:14189:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787381575.358203:0:14189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787381575.358205:0:14189:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787381575.358209:0:14189:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787381575.358216:0:14189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787381575.358217:0:14189:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787381575.358222:0:14189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787381575.358257:0:14189:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787381575.358270:0:14189:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787381575.358273:0:14189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787381575.358275:0:14189:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1787381575.358278:0:14189:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787381575.358280:0:14189:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #10 00000020:01000000:3.0:1787381575.358282:0:14189:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787381575.358283:0:14189:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787381575.358285:0:14189:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787381575.358287:0:14189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787381575.358288:0:14189:0:(obd_config.c:1561:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787381575.358291:0:14189:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787381575.358300:0:14189:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787381575.358303:0:14189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787381575.358305:0:14189:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787381575.358308:0:14189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787381575.358313:0:14189:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.122@tcp to nid 0x20000c0a8cb7a (192.168.203.122@tcp) 00000020:01000000:3.0:1787381575.358339:0:14189:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787381575.358342:0:14189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787381575.358355:0:14189:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9a16483d4d40) 00000020:00000080:3.0:1787381575.358368:0:14189:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1787381575.358373:0:14189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787381575.358424:0:14189:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787381575.358429:0:14189:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787381575.358435:0:14189:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbdc38ada7ea109d8 00010000:00080000:3.0:1787381575.358473:0:14189:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a16659a2000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.122@tcp at head 00010000:00010000:3.0:1787381575.358722:0:14189:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1787381575.359083:0:14189:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787381575.359132:0:14189:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787381575.360768:0:14189:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787381575.360837:0:14189:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1787381575.360909:0:14189:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1787381575.361373:0:14193:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787381575.361384:0:14193:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787381575.362284:0:14189:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787381575.362298:0:14189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787381575.362332:0:14189:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787381575.362349:0:14189:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbdc38ada7ea109df 00000100:00080000:3.0:1787381575.362360:0:14189:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787381575.362365:0:14189:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a16659a2000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:3.0:1787381575.362400:0:14189:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a167f59dc00 x1874205065957888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787381575.362429:0:14189:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787381575.362502:0:14189:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787381575.362512:0:14189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787381575.362514:0:14189:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787381575.362518:0:14189:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787381575.362522:0:14189:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1787381575.362523:0:14189:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787381575.362525:0:14189:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787381575.362526:0:14189:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787381575.362528:0:14189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787381575.362530:0:14189:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787381575.362532:0:14189:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787381575.362536:0:14189:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787381575.362539:0:14189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787381575.362540:0:14189:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787381575.362543:0:14189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787381575.362547:0:14189:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.122@tcp to nid 0x20000c0a8cb7a (192.168.203.122@tcp) 00000020:01000000:3.0:1787381575.362575:0:14189:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787381575.362578:0:14189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787381575.362589:0:14189:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9a16483d19c0) 00000020:00000080:3.0:1787381575.362602:0:14189:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1787381575.362607:0:14189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787381575.362662:0:14189:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787381575.362668:0:14189:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787381575.362673:0:14189:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xbdc38ada7ea109ed 00010000:00080000:3.0:1787381575.362701:0:14189:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a167f6ec000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.122@tcp at head 00010000:00010000:3.0:1787381575.362923:0:14189:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1787381575.363127:0:14189:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787381575.363149:0:14189:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:0.0:1787381575.363704:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1874205065957888:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787381575.363759:0:3307:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874205065957888 offset 0 length 520: 4 00000040:00080000:3.0:1787381575.364652:0:14189:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787381575.364728:0:14189:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1787381575.364811:0:14189:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1787381575.365754:0:14195:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787381575.365760:0:14195:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787381575.366446:0:14189:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787381575.366469:0:14189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787381575.366506:0:14189:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787381575.366524:0:14189:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbdc38ada7ea109f4 00000100:00080000:3.0:1787381575.366534:0:14189:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787381575.366539:0:14189:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a167f6ec000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:3.0:1787381575.366570:0:14189:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a167f59ea00 x1874205065958016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787381575.366626:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1874205065958016:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787381575.366679:0:3307:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874205065958016 offset 0 length 520: 4 00000100:00080000:3.0:1787381575.366732:0:14189:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787381575.366822:0:14189:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787381575.366826:0:14189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787381575.366828:0:14189:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787381575.366831:0:14189:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787381575.366835:0:14189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787381575.366836:0:14189:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787381575.366839:0:14189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787381575.366841:0:14189:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787381575.366842:0:14189:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787381575.366845:0:14189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787381575.366846:0:14189:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787381575.366848:0:14189:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787381575.366850:0:14189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787381575.366851:0:14189:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787381575.366854:0:14189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787381575.366881:0:14189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14189:1874205065958144:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787381575.366932:0:14189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381575.366967:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065958144 00000100:00100000:3.0:1787381575.366973:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065958144 00000100:00100000:3.0:1787381575.367083:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787381575.367092:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a395850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+9:14189:x1874205065958144:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787381575.367315:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a395850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+9:14189:x1874205065958144:12345-0@lo:502:llog_process_th.0 Request processed in 224us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381575.367333:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787381575.367373:0:14189:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a166d06f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787381575.367708:0:14189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14189:1874205065958144:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787381575.367737:0:14189:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787381575.367742:0:14189:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787381575.367743:0:14189:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787381575.367746:0:14189:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1787381575.368491:0:14153:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1787381575.368522:0:14153:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787381575.368635:0:14153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1647eb0400/0xbdc38ada7ea1097d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10984 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381575.368647:0:14153:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a1647eb0400/0xbdc38ada7ea1097d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10984 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787381575.368701:0:14153:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a15411ca800 from 1 10000000:01000000:3.0:1787381575.368704:0:14153:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787381575.368738:0:14153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1800/0xbdc38ada7ea109fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381575.368747:0:14153:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1800/0xbdc38ada7ea109fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381575.368756:0:14153:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1800/0xbdc38ada7ea109fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381575.368777:0:14153:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14153:1874205065958272:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787381575.368829:0:14153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381575.368866:0:14153:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a166d06f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787381575.368935:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065958272 00000100:00100000:1.0:1787381575.368942:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065958272 00000100:00100000:1.0:1787381575.368982:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787381575.368991:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a396c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+9:14153:x1874205065958272:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787381575.369025:0:14165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381575.369040:0:14165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1541388000/0xbdc38ada7ea10a02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea109fb expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381575.369078:0:14165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1541388000/0xbdc38ada7ea10a02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea109fb expref: 10 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381575.369090:0:14165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1541388000/0xbdc38ada7ea10a02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea109fb expref: 10 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381575.369099:0:14165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541388000, rc 0) 00000100:00100000:0.0:1787381575.369147:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a396c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+10:14153:x1874205065958272:12345-0@lo:101:mount.lustre.0 Request processed in 158us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381575.369155:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787381575.369404:0:14153:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14153:1874205065958272:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787381575.369418:0:14153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1800/0xbdc38ada7ea109fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10a02 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381575.369427:0:14153:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1800/0xbdc38ada7ea109fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea10a02 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381575.370378:0:14153:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542862a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14153:1874205065958400:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1787381575.370430:0:14153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381575.370476:0:14153:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1646f23840 going to sleep for 11 seconds 00000100:00100000:3.0:1787381575.370531:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065958400 00000100:00100000:3.0:1787381575.370538:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065958400 00000100:00100000:3.0:1787381575.370584:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787381575.370592:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a395c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+10:14153:x1874205065958400:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787381575.370610:0:14164:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787381575.370616:0:14164:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787381575.370691:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a395c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+10:14153:x1874205065958400:12345-0@lo:256:mount.lustre.0 Request processed in 99us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381575.370707:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787381575.371101:0:14153:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542862a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14153:1874205065958400:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1787381575.371803:0:14153:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787381575.371864:0:14153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1800/0xbdc38ada7ea109fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10a02 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381575.371875:0:14153:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1800/0xbdc38ada7ea109fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10a02 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787381575.371884:0:14153:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a15411ca800 from 1 10000000:01000000:0.0:1787381575.371891:0:14153:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787381575.371925:0:14153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a16460c8600/0xbdc38ada7ea10a09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381575.371933:0:14153:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a16460c8600/0xbdc38ada7ea10a09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381575.371942:0:14153:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a16460c8600/0xbdc38ada7ea10a09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381575.371959:0:14153:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542862a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14153:1874205065958528:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787381575.371999:0:14153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381575.372304:0:14153:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1646f23840 going to sleep for 11 seconds 00000100:00100000:3.0:1787381575.372372:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065958528 00000100:00100000:3.0:1787381575.372378:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065958528 00000100:00100000:3.0:1787381575.372449:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787381575.372473:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a397450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+10:14153:x1874205065958528:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787381575.372485:0:14165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381575.372501:0:14165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1647eb1200/0xbdc38ada7ea10a10 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea10a09 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381575.372521:0:14165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1647eb1200/0xbdc38ada7ea10a10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea10a09 expref: 11 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381575.372530:0:14165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1647eb1200/0xbdc38ada7ea10a10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea10a09 expref: 11 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381575.372536:0:14165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb1200, rc 0) 00000100:00100000:3.0:1787381575.372623:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a397450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+11:14153:x1874205065958528:12345-0@lo:101:mount.lustre.0 Request processed in 166us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381575.372631:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787381575.372684:0:14153:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542862a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14153:1874205065958528:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787381575.372696:0:14153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a16460c8600/0xbdc38ada7ea10a09 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10a10 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381575.372704:0:14153:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a16460c8600/0xbdc38ada7ea10a09 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea10a10 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381575.372756:0:14153:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14153:1874205065958656:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787381575.372783:0:14153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381575.372808:0:14153:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167a7d6240 going to sleep for 11 seconds 00000100:00100000:0.0:1787381575.372859:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065958656 00000100:00100000:0.0:1787381575.372864:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065958656 00000100:00100000:0.0:1787381575.372927:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787381575.372935:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a396850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+11:14153:x1874205065958656:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787381575.373318:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a396850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+11:14153:x1874205065958656:12345-0@lo:501:mount.lustre.0 Request processed in 383us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381575.373327:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787381575.373342:0:14153:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14153:1874205065958656:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787381575.373381:0:14153:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14153:1874205065958784:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787381575.373420:0:14153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381575.373447:0:14153:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a166d06f900 going to sleep for 11 seconds 00000100:00100000:0.0:1787381575.373450:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065958784 00000100:00100000:0.0:1787381575.373454:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065958784 00000100:00100000:0.0:1787381575.373496:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787381575.373502:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a394050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+11:14153:x1874205065958784:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787381575.373647:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a394050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+11:14153:x1874205065958784:12345-0@lo:503:mount.lustre.0 Request processed in 144us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381575.373654:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787381575.373720:0:14153:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14153:1874205065958784:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787381575.374553:0:14197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542860e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14197:1874205065958912:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787381575.374590:0:14197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381575.374618:0:14197:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1646f23000 going to sleep for 11 seconds 00000100:00100000:1.0:1787381575.374639:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065958912 00000100:00100000:1.0:1787381575.374647:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065958912 00000100:00100000:1.0:1787381575.374687:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787381575.374695:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a397050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+11:14197:x1874205065958912:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787381575.375168:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a397050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+11:14197:x1874205065958912:12345-0@lo:502:llog_process_th.0 Request processed in 467us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381575.375177:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787381575.375324:0:14197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542860e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14197:1874205065958912:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787381575.375352:0:14197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787381575.375362:0:14197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787381575.375364:0:14197:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787381575.375372:0:14197:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a15411ca800 00000020:00000080:0.0:1787381575.375375:0:14197:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787381575.375382:0:14197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787381575.375384:0:14197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787381575.375385:0:14197:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787381575.375387:0:14197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787381575.375389:0:14197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787381575.375397:0:14197:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787381575.375401:0:14197:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a15411ca800 00000020:00000080:0.0:1787381575.375403:0:14197:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787381575.375472:0:14197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787381575.375477:0:14197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787381575.375478:0:14197:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787381575.375480:0:14197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787381575.375483:0:14197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787381575.375484:0:14197:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787381575.375488:0:14197:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a15411ca800 00000020:00000080:0.0:1787381575.375490:0:14197:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787381575.375527:0:14197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542860e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14197:1874205065959040:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787381575.375564:0:14197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381575.376136:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065959040 00000100:00100000:0.0:1787381575.376141:0:14197:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a164b71f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787381575.376143:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065959040 00000100:00100000:2.0:1787381575.376192:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787381575.376202:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a396050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+11:14197:x1874205065959040:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787381575.376873:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a396050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+11:14197:x1874205065959040:12345-0@lo:502:llog_process_th.0 Request processed in 672us (1306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381575.376892:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787381575.377339:0:14197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542860e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14197:1874205065959040:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787381575.377366:0:14197:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787381575.377373:0:14197:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787381575.377375:0:14197:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787381575.377380:0:14197:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787381575.377638:0:14153:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787381575.377657:0:14153:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787381575.377680:0:14153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a16460c8600/0xbdc38ada7ea10a09 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10a10 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381575.377692:0:14153:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a16460c8600/0xbdc38ada7ea10a09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10a10 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787381575.377742:0:14153:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787381575.377746:0:14153:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a15411ca800 10000000:01000000:3.0:1787381575.377749:0:14153:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a15411ca800 10000000:01000000:3.0:1787381575.377754:0:14153:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787381575.377760:0:14153:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a15411ca800 from 1 10000000:01000000:3.0:1787381575.377763:0:14153:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787381575.377793:0:14153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1a00/0xbdc38ada7ea10a17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381575.377802:0:14153:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1a00/0xbdc38ada7ea10a17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381575.377811:0:14153:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1a00/0xbdc38ada7ea10a17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381575.377828:0:14153:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14153:1874205065959168:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787381575.377869:0:14153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381575.377935:0:14153:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1652067cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787381575.378129:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065959168 00000100:00100000:0.0:1787381575.378136:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065959168 00000100:00100000:0.0:1787381575.378179:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787381575.378187:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a395450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+11:14153:x1874205065959168:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787381575.378199:0:14164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381575.378210:0:14164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a16460c9400/0xbdc38ada7ea10a1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea10a17 expref: -99 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381575.378230:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a16460c9400/0xbdc38ada7ea10a1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea10a17 expref: 12 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381575.378250:0:14164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a16460c9400/0xbdc38ada7ea10a1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea10a17 expref: 12 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381575.378259:0:14164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16460c9400, rc 0) 00000100:00100000:0.0:1787381575.378303:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a395450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+12:14153:x1874205065959168:12345-0@lo:101:mount.lustre.0 Request processed in 117us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381575.378310:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787381575.378391:0:14153:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14153:1874205065959168:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787381575.378401:0:14153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1a00/0xbdc38ada7ea10a17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10a1e expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381575.378553:0:14153:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1a00/0xbdc38ada7ea10a17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea10a1e expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381575.378607:0:14153:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14153:1874205065959296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787381575.378708:0:14153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381575.378746:0:14153:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1652067cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787381575.379067:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065959296 00000100:00100000:2.0:1787381575.379073:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065959296 00000100:00100000:2.0:1787381575.379100:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787381575.379107:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a394850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+12:14153:x1874205065959296:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787381575.379354:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a394850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+12:14153:x1874205065959296:12345-0@lo:501:mount.lustre.0 Request processed in 247us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381575.379361:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787381575.379573:0:14153:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14153:1874205065959296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787381575.379608:0:14153:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14153:1874205065959424:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787381575.379660:0:14153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381575.379692:0:14153:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1652067cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787381575.379715:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065959424 00000100:00100000:2.0:1787381575.379721:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065959424 00000100:00100000:2.0:1787381575.379750:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787381575.379757:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fcbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+12:14153:x1874205065959424:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787381575.379891:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fcbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+12:14153:x1874205065959424:12345-0@lo:503:mount.lustre.0 Request processed in 133us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381575.379898:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787381575.380103:0:14153:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14153:1874205065959424:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787381575.380559:0:14199:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14199:1874205065959552:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787381575.380608:0:14199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381575.380799:0:14199:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1652067e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787381575.380827:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065959552 00000100:00100000:2.0:1787381575.380833:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065959552 00000100:00100000:2.0:1787381575.380870:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787381575.380878:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fcba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+12:14199:x1874205065959552:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787381575.381078:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fcba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+12:14199:x1874205065959552:12345-0@lo:502:llog_process_th.0 Request processed in 200us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381575.381086:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787381575.381192:0:14199:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14199:1874205065959552:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1787381575.381249:0:14199:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787381575.381273:0:14199:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9a16765e3380) 00000020:00000080:3.0:1787381575.381295:0:14199:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1787381575.381472:0:14199:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a15411ca800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787381575.381476:0:14199:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a15411ca800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787381575.381479:0:14199:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a15411ca800 4 00010000:00080000:3.0:1787381575.381504:0:14199:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a167533c000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.122@tcp at head 00010000:00010000:3.0:1787381575.383587:0:14199:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1787381575.383711:0:14199:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1787381575.383765:0:14199:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787381575.383778:0:14199:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xbdc38ada7ea10a2c 00000100:00080000:3.0:1787381575.383787:0:14199:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787381575.383794:0:14199:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a167533c000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:3.0:1787381575.383827:0:14199:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a167f59f480 x1874205065959680/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787381575.383866:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874205065959680:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787381575.383941:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381575.384032:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065959680 00000100:00100000:3.0:1787381575.384039:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065959680 00000100:00100000:3.0:1787381575.384066:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787381575.384073:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1874205065959680:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787381575.384126:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1874205065959680:12345-0@lo:38:llog_process_th.0 Request processed in 50us (183us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787381575.384134:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787381575.384167:0:3307:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787381575.384174:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9a167533c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787381575.384188:0:3307:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787381575.384192:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874205065959680:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1787381575.384226:0:14199:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787381575.390359:0:14199:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14199:1874205065959808:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787381575.390447:0:14199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381575.390500:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065959808 00000100:00100000:3.0:1787381575.390507:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065959808 00000100:00100000:3.0:1787381575.390548:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787381575.390558:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fcb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+12:14199:x1874205065959808:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787381575.391581:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fcb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+12:14199:x1874205065959808:12345-0@lo:502:llog_process_th.0 Request processed in 1019us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381575.391593:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787381575.391908:0:14199:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16500fb780 going to sleep for 11 seconds 00000100:00100000:3.0:1787381575.391934:0:14199:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14199:1874205065959808:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1787381575.391970:0:14199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787381575.393942:0:14153:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787381575.393984:0:14153:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787381575.394027:0:14153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1a00/0xbdc38ada7ea10a17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10a1e expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381575.394052:0:14153:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1a00/0xbdc38ada7ea10a17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10a1e expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787381575.394103:0:14153:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787381575.394106:0:14153:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787381575.394107:0:14153:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787381575.394109:0:14153:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787381575.394111:0:14153:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787381575.394112:0:14153:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787381575.394114:0:14153:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787381575.394115:0:14153:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787381575.394117:0:14153:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787381575.394118:0:14153:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787381575.394122:0:14153:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1787381575.394125:0:14153:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787381575.394126:0:14153:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787381575.394127:0:14153:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787381575.394128:0:14153:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787381575.394129:0:14153:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787381575.394131:0:14153:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787381575.394132:0:14153:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787381575.394133:0:14153:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787381575.394135:0:14153:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787381575.394136:0:14153:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787381575.394160:0:14153:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787381575.394180:0:14153:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14153:1874205065959936:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787381575.394245:0:14153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381575.394288:0:14153:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fbac600 going to sleep for 11 seconds 00000100:00100000:3.0:1787381575.394369:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065959936 00000100:00100000:3.0:1787381575.394377:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065959936 00000100:00100000:3.0:1787381575.394430:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787381575.394440:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fcba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+12:14153:x1874205065959936:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787381575.394478:0:14164:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787381575.394493:0:14164:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787381575.437050:0:14164:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787381575.437065:0:14164:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1787381575.437091:0:14187:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787381575.437096:0:14187:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787381575.437129:0:14187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a1647eb1400/0xbdc38ada7ea10a33 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381575.437153:0:14187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a1541388000/0xbdc38ada7ea10a02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea109fb expref: 12 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381575.437162:0:14187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a1647eb1400/0xbdc38ada7ea10a33 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381575.437208:0:14187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a1541388000/0xbdc38ada7ea10a02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbdc38ada7ea109fb expref: 12 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381575.437226:0:14187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a1541388000/0xbdc38ada7ea10a02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbdc38ada7ea109fb expref: 12 pid: 14165 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381575.437256:0:14187:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14187:1874205065960064:0@lo:104: 00000100:00100000:3.0:1787381575.437326:0:14187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381575.437370:0:14187:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16500fb600 going to sleep for 11 seconds 00000100:00100000:2.0:1787381575.439585:0:14154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065960064 00000100:00100000:2.0:1787381575.439600:0:14154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065960064 00000100:00100000:2.0:1787381575.439664:0:14154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787381575.439673:0:14154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+3:14187:x1874205065960064:12345-0@lo:104: 00010000:00010000:2.0:1787381575.439689:0:14154:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1800/0xbdc38ada7ea109fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea10a02 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381575.439785:0:14154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787381575.439792:0:14154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+3:14187:x1874205065960064:12345-0@lo:104: Request processed in 121us (2465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381575.439801:0:14154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787381575.439848:0:14187:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14187:1874205065960064:0@lo:104: 00010000:00010000:2.0:1787381575.439871:0:14187:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a1647eb1400/0xbdc38ada7ea10a33 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381575.439889:0:14160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787381575.441171:0:14160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1800/0xbdc38ada7ea109fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea10a02 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381575.441181:0:14160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb1800 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:2.0:1787381575.441186:0:14160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1800/0xbdc38ada7ea109fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbdc38ada7ea10a02 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381575.441195:0:14160:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1800/0xbdc38ada7ea109fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbdc38ada7ea10a02 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787381575.441202:0:14160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1800/0xbdc38ada7ea109fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbdc38ada7ea10a02 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787381575.441208:0:14160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787381575.441249:0:14160:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1800/0xbdc38ada7ea109fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea10a02 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381575.441255:0:14160:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787381575.441288:0:14160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1800/0xbdc38ada7ea109fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea10a02 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381575.441310:0:14160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1800/0xbdc38ada7ea109fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea10a02 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381575.441323:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:3308:1874205065960192:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787381575.441325:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381575.441327:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381575.441328:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787381575.441380:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381575.444772:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065960192 00000100:00100000:2.0:1787381575.444789:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065960192 00010000:00010000:2.0:1787381575.444830:0:14156:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a1541388000/0xbdc38ada7ea10a02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea109fb expref: 13 pid: 14165 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381575.444874:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787381575.444884:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542860e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+13:3308:x1874205065960192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787381575.444897:0:14156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787381575.444903:0:14156:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a1541388000/0xbdc38ada7ea10a02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea109fb expref: 13 pid: 14165 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381575.444917:0:14156:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a1541388000/0xbdc38ada7ea10a02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbdc38ada7ea109fb expref: 13 pid: 14165 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381575.444938:0:14156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1541388000/0xbdc38ada7ea10a02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbdc38ada7ea109fb expref: 13 pid: 14165 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381575.444954:0:14156:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a1647eb1400/0xbdc38ada7ea10a33 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381575.444962:0:14156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1647eb1400/0xbdc38ada7ea10a33 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787381575.445162:0:14156:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008067035s 00010000:00010000:2.0:1787381575.445169:0:14156:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a1647eb1400/0xbdc38ada7ea10a33 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381575.445176:0:14156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a1647eb1400/0xbdc38ada7ea10a33 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381575.445183:0:14156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a1647eb1400/0xbdc38ada7ea10a33 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381575.445189:0:14156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a1647eb1400/0xbdc38ada7ea10a33 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381575.445196:0:14156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb1400 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:2.0:1787381575.445201:0:14156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a1647eb1400/0xbdc38ada7ea10a33 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381575.445209:0:14156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a1647eb1400/0xbdc38ada7ea10a33 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381575.448225:0:14156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a1647eb1400/0xbdc38ada7ea10a33 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381575.448377:0:14156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787381575.448553:0:14187:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a1647eb1400/0xbdc38ada7ea10a33 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381575.448563:0:14187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a1647eb1400/0xbdc38ada7ea10a33 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381575.448570:0:14187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1647eb1400/0xbdc38ada7ea10a33 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381575.449677:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542860e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+12:3308:x1874205065960192:12345-0@lo:103:ldlm_bl.0 Request processed in 4730us (8232us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381575.449690:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787381575.452258:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:3308:1874205065960192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787381575.452666:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fcba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+11:14153:x1874205065959936:12345-0@lo:253:mount.lustre.0 Request processed in 58226us (58418us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381575.452678:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787381575.452795:0:14153:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14153:1874205065959936:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787381575.452810:0:14153:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787381575.452824:0:14153:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787381575.452826:0:14153:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787381575.452827:0:14153:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787381575.452828:0:14153:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787381575.452829:0:14153:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787381575.452831:0:14153:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787381575.452832:0:14153:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787381575.452834:0:14153:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787381575.452835:0:14153:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787381575.452837:0:14153:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787381575.452849:0:14153:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787381575.459039:0:14153:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1787381575.459202:0:14153:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787381575.459481:0:14153:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1787381575.459636:0:14153:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787381575.459893:0:14153:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1787381575.460962:0:14153:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1787381575.462794:0:14153:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1787381575.462984:0:14153:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1787381575.463298:0:14153:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1787381575.463547:0:14153:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1787381575.463958:0:14153:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1787381575.464233:0:14153:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1787381575.493981:0:14153:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1787381575.494413:0:14153:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1787381575.494764:0:14210:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1787381575.494828:0:14210:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787381575.496615:0:14210:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787381575.496697:0:14210:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787381575.496702:0:14210:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1787381575.498831:0:14153:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787381575.498953:0:14153:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787381575.499428:0:14153:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787381575.499435:0:14153:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787381575.499549:0:14153:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787381575.500409:0:14153:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000020:00080000:3.0:1787381575.500784:0:14209:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1787381575.500789:0:14209:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:1.0:1787381575.505241:0:14153:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787381575.505317:0:14153:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1787381575.510977:0:14153:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1787381575.520522:0:14153:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1787381575.552162:0:14153:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787381575.552207:0:14153:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb6ca01d83988 00100000:10000000:0.0:1787381575.552214:0:14153:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787381575.552915:0:14153:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787381575.552929:0:14153:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.122@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787381575.552945:0:14153:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787381575.552969:0:14153:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1787381576.013565:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787381576.465704:0:14205:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1787381576.974091:0:14169:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787381576.974099:0:14169:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a15411ca800 from 6 10000000:01000000:3.0:1787381576.974104:0:14169:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787381576.974150:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1400/0xbdc38ada7ea10a3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381576.974163:0:14169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1400/0xbdc38ada7ea10a3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381576.974174:0:14169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1400/0xbdc38ada7ea10a3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381576.974199:0:14169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14169:1874205065960320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787381576.974279:0:14169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381576.974346:0:14169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f5b3300 going to sleep for 11 seconds 00000100:00100000:1.0:1787381576.974466:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065960320 00000100:00100000:1.0:1787381576.974474:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065960320 00000100:00100000:1.0:1787381576.974538:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787381576.974547:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fcbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+11:14169:x1874205065960320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787381576.974562:0:14165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381576.974578:0:14165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1541388a00/0xbdc38ada7ea10a41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea10a3a expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381576.974601:0:14165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1541388a00/0xbdc38ada7ea10a41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea10a3a expref: 12 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381576.974625:0:14165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1541388a00/0xbdc38ada7ea10a41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea10a3a expref: 12 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381576.974634:0:14165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541388a00, rc 0) 00000100:00100000:1.0:1787381576.974679:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fcbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+12:14169:x1874205065960320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381576.974686:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787381576.974733:0:14169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14169:1874205065960320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787381576.974747:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1400/0xbdc38ada7ea10a3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10a41 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381576.974756:0:14169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1400/0xbdc38ada7ea10a3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea10a41 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381576.974809:0:14169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14169:1874205065960448:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787381576.974840:0:14169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381576.974861:0:14169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167a372180 going to sleep for 11 seconds 00000100:00100000:1.0:1787381576.974872:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065960448 00000100:00100000:1.0:1787381576.974876:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065960448 00000100:00100000:1.0:1787381576.974897:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787381576.974903:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fcb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+12:14169:x1874205065960448:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787381576.974916:0:14164:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787381576.974932:0:14164:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787381576.974935:0:14164:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1787381576.975040:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fcb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+12:14169:x1874205065960448:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 136us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381576.975056:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787381576.975085:0:14169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14169:1874205065960448:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787381576.975121:0:14169:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787381576.975127:0:14169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1400/0xbdc38ada7ea10a3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10a41 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381576.975135:0:14169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1400/0xbdc38ada7ea10a3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10a41 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381577.037751:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787381577.484781:0:14205:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787381578.060083:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381579.084197:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787381579.790348:0:14453:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787381580.110842:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787381580.621258:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787381580.621265:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787381580.621268:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787381580.621270:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787381580.621272:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787381580.621275:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787381580.621279:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a167533c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787381580.621290:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a167533c000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:0.0:1787381580.621310:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a1542862680 x1874205065960704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787381580.621462:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787381580.621474:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542860380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:3308:1874205065960576:0@lo:400:kworker.0 00000100:00100000:0.0:1787381580.621542:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381580.621615:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065960576 00000100:00100000:0.0:1787381580.621623:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065960576 00000100:00100000:0.0:1787381580.621664:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787381580.621673:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fcbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+12:3308:x1874205065960576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381580.621723:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fcbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+12:3308:x1874205065960576:12345-0@lo:400:kworker.0 Request processed in 50us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381580.621730:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787381580.621776:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542862680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874205065960704:0@lo:38:kworker.0 00000100:00100000:0.0:1787381580.621808:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381580.621863:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542860380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:3308:1874205065960576:0@lo:400:kworker.0 00000100:00100000:2.0:1787381580.622339:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065960704 00000100:00100000:2.0:1787381580.622344:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065960704 00000100:00100000:2.0:1787381580.622368:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787381580.622374:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542861500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1874205065960704:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787381580.622396:0:14173:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 438 last 0 00000020:00000080:2.0:1787381580.622445:0:14173:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xbdc38ada7ea10a48 00000004:00100000:2.0:1787381580.622460:0:14173:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787381580.622593:0:14173:0:(import.c:65:import_set_state_nolock()) ffff9a16436a5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787381580.622644:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542861500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874205065960704:12345-0@lo:38:kworker.0 Request processed in 268us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381580.622650:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787381580.622698:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a1542862680 x1874205065960704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787381590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787381580.622724:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787381580.622732:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787381580.622738:0:3307:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787381580.622740:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9a167533c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787381580.622746:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542862680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874205065960704:0@lo:38:kworker.0 00010000:00010000:1.0:1787381581.134188:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381582.157392:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787381582.632393:0:14603:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffd1a02d2d0 00000020:00000080:2.0:1787381582.632481:0:14603:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:2.0:1787381582.632486:0:14603:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:2.0:1787381582.632495:0:14603:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd1a02f560 20000000:00000080:2.0:1787381582.632503:0:14603:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a1676589800 uarg=0000000000000000 20000000:01000000:2.0:1787381582.632539:0:14603:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787381582.632545:0:14603:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787381582.632549:0:14603:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787381582.636953:0:14604:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1787381582.637135:0:14603:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787381582.644643:0:14603:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787381582.645117:0:14603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a1647eb1800/0xbdc38ada7ea10a4f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381582.645136:0:14603:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a1647eb1200/0xbdc38ada7ea10a10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea10a09 expref: 11 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381582.645145:0:14603:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a1647eb1800/0xbdc38ada7ea10a4f lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381582.645187:0:14603:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a1647eb1200/0xbdc38ada7ea10a10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbdc38ada7ea10a09 expref: 11 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381582.645202:0:14603:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a1647eb1200/0xbdc38ada7ea10a10 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbdc38ada7ea10a09 expref: 11 pid: 14165 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381582.645218:0:14603:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14603:1874205065960832:0@lo:104: 00000100:00100000:3.0:1787381582.645298:0:14603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381582.645400:0:14603:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f5b3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787381582.648086:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065960832 00000100:00100000:0.0:1787381582.648100:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065960832 00000100:00100000:0.0:1787381582.648194:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787381582.648204:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+3:14603:x1874205065960832:12345-0@lo:104: 00010000:00010000:0.0:1787381582.648220:0:14155:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9a16460c8600/0xbdc38ada7ea10a09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea10a10 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381582.648654:0:14155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787381582.648661:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+3:14603:x1874205065960832:12345-0@lo:104: Request processed in 459us (3364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381582.648669:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1787381582.648701:0:14160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787381582.648710:0:14160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a16460c8600/0xbdc38ada7ea10a09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea10a10 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381582.648717:0:14160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c8600 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:1.0:1787381582.648721:0:14160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a16460c8600/0xbdc38ada7ea10a09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbdc38ada7ea10a10 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381582.648729:0:14160:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a16460c8600/0xbdc38ada7ea10a09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbdc38ada7ea10a10 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381582.648734:0:14603:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14603:1874205065960832:0@lo:104: 10000000:00010000:1.0:1787381582.648736:0:14160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a16460c8600/0xbdc38ada7ea10a09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbdc38ada7ea10a10 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381582.648757:0:14603:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a1647eb1800/0xbdc38ada7ea10a4f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787381582.648767:0:14160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787381582.648810:0:14160:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a16460c8600/0xbdc38ada7ea10a09 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea10a10 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381582.648815:0:14160:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787381582.648841:0:14160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a16460c8600/0xbdc38ada7ea10a09 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea10a10 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381582.648848:0:14160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a16460c8600/0xbdc38ada7ea10a09 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea10a10 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381582.648864:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381582.648866:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381582.648867:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787381582.648881:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787381582.648892:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:3311:1874205065960960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787381582.648928:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381582.649047:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065960960 00000100:00100000:1.0:1787381582.649052:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065960960 00010000:00010000:1.0:1787381582.649069:0:14157:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a1647eb1200/0xbdc38ada7ea10a10 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea10a09 expref: 12 pid: 14165 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381582.649088:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787381582.649095:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542860380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+12:3311:x1874205065960960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787381582.649104:0:14157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381582.649109:0:14157:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a1647eb1200/0xbdc38ada7ea10a10 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea10a09 expref: 12 pid: 14165 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381582.649119:0:14157:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a1647eb1200/0xbdc38ada7ea10a10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbdc38ada7ea10a09 expref: 12 pid: 14165 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381582.649133:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1647eb1200/0xbdc38ada7ea10a10 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbdc38ada7ea10a09 expref: 12 pid: 14165 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381582.649152:0:14157:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a1647eb1800/0xbdc38ada7ea10a4f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381582.649159:0:14157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1647eb1800/0xbdc38ada7ea10a4f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381582.649173:0:14157:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a1647eb1800/0xbdc38ada7ea10a4f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381582.649180:0:14157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a1647eb1800/0xbdc38ada7ea10a4f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381582.649187:0:14157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a1647eb1800/0xbdc38ada7ea10a4f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381582.649193:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a1647eb1800/0xbdc38ada7ea10a4f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381582.649198:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb1800 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:1.0:1787381582.649202:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a1647eb1800/0xbdc38ada7ea10a4f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381582.649209:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a1647eb1800/0xbdc38ada7ea10a4f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381582.649220:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a1647eb1800/0xbdc38ada7ea10a4f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381582.649239:0:14157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381582.649276:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542860380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+11:3311:x1874205065960960:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381582.649288:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787381582.649508:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:3311:1874205065960960:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787381582.651988:0:14603:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a1647eb1800/0xbdc38ada7ea10a4f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381582.652112:0:14603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a1647eb1800/0xbdc38ada7ea10a4f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381582.652120:0:14603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1647eb1800/0xbdc38ada7ea10a4f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381583.180992:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381584.204275:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787381584.204784:0:14169:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787381584.204788:0:14169:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a15411ca800 from 10 10000000:01000000:1.0:1787381584.204794:0:14169:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787381584.204837:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea10a56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381584.204848:0:14169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea10a56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381584.204859:0:14169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea10a56 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381584.204885:0:14169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14169:1874205065961088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787381584.204966:0:14169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381584.205046:0:14169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a164b71f480 going to sleep for 11 seconds 00000100:00100000:3.0:1787381584.205226:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065961088 00000100:00100000:3.0:1787381584.205235:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065961088 00000100:00100000:3.0:1787381584.205297:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787381584.205307:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fcba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+11:14169:x1874205065961088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787381584.205319:0:14166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381584.205334:0:14166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1647eb0600/0xbdc38ada7ea10a5d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea10a56 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381584.205356:0:14166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1647eb0600/0xbdc38ada7ea10a5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea10a56 expref: 12 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381584.205368:0:14166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1647eb0600/0xbdc38ada7ea10a5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea10a56 expref: 12 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381584.205376:0:14166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb0600, rc 0) 00000100:00100000:3.0:1787381584.205434:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fcba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+12:14169:x1874205065961088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381584.205441:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787381584.205536:0:14169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14169:1874205065961088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787381584.205550:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea10a56 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10a5d expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381584.205558:0:14169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea10a56 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea10a5d expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381584.205606:0:14169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14169:1874205065961216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787381584.205636:0:14169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381584.205667:0:14169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a164b71f480 going to sleep for 11 seconds 00000100:00100000:2.0:1787381584.205728:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065961216 00000100:00100000:2.0:1787381584.205732:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065961216 00000100:00100000:2.0:1787381584.205764:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787381584.205771:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fcb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+12:14169:x1874205065961216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787381584.206039:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fcb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+12:14169:x1874205065961216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 267us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381584.206047:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787381584.206068:0:14169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14169:1874205065961216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787381584.206099:0:14169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14169:1874205065961344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787381584.206137:0:14169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381584.206166:0:14169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f5b39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787381584.207093:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065961344 00000100:00100000:2.0:1787381584.207102:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065961344 00000100:00100000:2.0:1787381584.207141:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787381584.207149:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646543450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+12:14169:x1874205065961344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787381584.207340:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646543450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+12:14169:x1874205065961344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 191us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381584.207348:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787381584.207384:0:14169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14169:1874205065961344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787381584.213030:0:14665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787381584.213189:0:14169:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787381584.213215:0:14169:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787381584.213228:0:14169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea10a56 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10a5d expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381584.213240:0:14169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea10a56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10a5d expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381585.229501:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787381585.742672:0:3307:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787381575/real 1787381575] req@ffff9a167f59ea00 x1874205065958016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787381585 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381585.742701:0:3307:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a167f59ea00 x1874205065958016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787381585 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381585.742710:0:3307:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787381575/real 1787381575] req@ffff9a167f59dc00 x1874205065957888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787381585 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381585.742721:0:3307:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a167f59dc00 x1874205065957888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787381585 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787381585.742738:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9a167f6ec000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787381585.742748:0:3307:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787381585.742753:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1874205065958016:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787381585.742758:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9a16659a2000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787381585.742762:0:3307:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787381585.742765:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1874205065957888:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787381585.743044:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787381585.743048:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787381585.743058:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a16659a2000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787381585.743063:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 433 00000100:00080000:3.0:1787381585.743068:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787381585.743075:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a16659a2000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:3.0:1787381585.743095:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a167f59e680 x1874205065961600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787381585.743109:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787381585.743112:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787381585.743114:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a167f6ec000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787381585.743117:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 433 00000100:00080000:3.0:1787381585.743119:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787381585.743122:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a167f6ec000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:3.0:1787381585.743132:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a167f59e300 x1874205065961728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787381585.743169:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1874205065961600:0@lo:8:kworker.0 00000400:00000100:3.0:1787381585.743217:0:3307:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874205065961600 offset 0 length 520: 4 00000100:00100000:3.0:1787381585.743257:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1874205065961728:0@lo:8:kworker.0 00000400:00000100:3.0:1787381585.743274:0:3307:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874205065961728 offset 0 length 520: 4 00000100:00100000:0.0:1787381585.743345:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:3311:1874205065961472:0@lo:400:kworker.0 00000100:00100000:0.0:1787381585.743396:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381585.743435:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874205065961856:0@lo:400:kworker.0 00000100:00100000:0.0:1787381585.743460:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381585.743500:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065961856 00000100:00100000:0.0:1787381585.743507:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065961856 00000100:00100000:0.0:1787381585.743545:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787381585.743625:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542863100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874205065961856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381585.743676:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542863100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874205065961856:12345-0@lo:400:kworker.0 Request processed in 123us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381585.743683:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787381585.743716:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a167f59fb80 x1874205065961856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787381601 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381585.743728:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874205065961856:0@lo:400:kworker.0 00000100:00100000:3.0:1787381585.744435:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065961472 00000100:00100000:3.0:1787381585.744443:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065961472 00000100:00100000:3.0:1787381585.744507:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787381585.744515:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646542c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+12:3311:x1874205065961472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787381585.744644:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646542c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+12:3311:x1874205065961472:12345-0@lo:400:kworker.0 Request processed in 129us (1256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381585.744653:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787381585.744702:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:3311:1874205065961472:0@lo:400:kworker.0 00010000:00010000:3.0:1787381586.254916:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787381586.873806:0:14804:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787381586.873810:0:14804:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1787381586.873918:0:14804:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a1644e4b000 00000020:01000004:1.0:1787381586.873997:0:14804:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787381586.874028:0:14804:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787381586.874053:0:14804:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9a1646468000) 00000020:00000080:1.0:1787381586.874068:0:14804:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787381586.900687:0:14804:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787381586.900944:0:14804:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787381586.901906:0:14804:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787381586.902334:0:14804:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787381586.902553:0:14804:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787381586.903049:0:14804:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:2.0:1787381586.903160:0:14804:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:2.0:1787381586.903262:0:14804:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:2.0:1787381586.903867:0:14804:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 719: rc = 0 00100000:10000000:2.0:1787381586.904293:0:14804:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 719: rc = 0 00100000:10000000:2.0:1787381586.904563:0:14804:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 719: rc = 0 00100000:10000000:2.0:1787381586.904884:0:14804:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 719: rc = 0 00100000:10000000:2.0:1787381586.905298:0:14804:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 719: rc = 0 00100000:10000000:2.0:1787381586.905570:0:14804:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 719: rc = 0 00000020:00000080:2.0:1787381586.906390:0:14804:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787381586.906402:0:14804:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787381586.906412:0:14804:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbdc38ada7ea10a6b 00000020:01000004:2.0:1787381586.906421:0:14804:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787381586.906443:0:14804:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.122@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787381586.906447:0:14804:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.122@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787381586.906453:0:14804:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787381586.906458:0:14804:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787381586.906469:0:14804:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9a167b570000) 00000020:00000080:2.0:1787381586.906481:0:14804:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1787381586.907886:0:14804:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787381586.908165:0:14804:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787381586.908171:0:14804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787381586.917413:0:14804:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787381586.917427:0:14804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1787381586.917926:0:14804:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1787381586.917933:0:14804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787381586.919443:0:14804:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787381586.920529:0:14804:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787381586.920536:0:14804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1787381586.921785:0:14804:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1787381586.921792:0:14804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787381586.957110:0:14804:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787381586.957313:0:14804:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787381586.957319:0:14804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787381586.958803:0:14804:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787381586.958813:0:14804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787381586.961057:0:14804:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787381586.961072:0:14804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787381586.963144:0:14804:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787381586.963321:0:14804:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787381586.963342:0:14804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787381586.964185:0:14804:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787381586.964195:0:14804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787381587.019962:0:14804:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787381587.020191:0:14804:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787381587.020197:0:14804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787381587.022242:0:14804:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787381587.022256:0:14804:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787381587.024259:0:14804:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787381587.024292:0:14804:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1787381587.024299:0:14804:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.122@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787381587.044994:0:14804:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.122@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787381587.045061:0:14804:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.122@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1787381587.045065:0:14804:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787381587.045067:0:14804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787381587.045068:0:14804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787381587.045069:0:14804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787381587.045071:0:14804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787381587.045077:0:14804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787381587.045078:0:14804:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787381587.045080:0:14804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787381587.045081:0:14804:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787381587.045085:0:14804:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1787381587.045087:0:14804:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787381587.045088:0:14804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787381587.045089:0:14804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787381587.045090:0:14804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787381587.045091:0:14804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787381587.045092:0:14804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787381587.045093:0:14804:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787381587.045093:0:14804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787381587.045094:0:14804:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787381587.045120:0:14804:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787381587.045139:0:14804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542861880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14804:1874205065961984:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787381587.045220:0:14804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381587.045278:0:14804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fbac540 going to sleep for 11 seconds 00000100:00100000:3.0:1787381587.046482:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065961984 00000100:00100000:3.0:1787381587.046494:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065961984 00000100:00100000:3.0:1787381587.046560:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787381587.046571:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646540c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+12:14804:x1874205065961984:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787381587.046617:0:14166:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787381587.046620:0:14166:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1787381587.046624:0:14166:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787381587.065960:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646540c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+12:14804:x1874205065961984:12345-0@lo:253:mount.lustre.0 Request processed in 19383us (20730us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381587.065975:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787381587.066099:0:14804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542861880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14804:1874205065961984:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787381587.066113:0:14804:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787381587.066116:0:14804:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787381587.066118:0:14804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787381587.066120:0:14804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787381587.066121:0:14804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787381587.066122:0:14804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787381587.066124:0:14804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787381587.066125:0:14804:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787381587.066127:0:14804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787381587.066128:0:14804:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787381587.066159:0:14804:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a1644e4b000 from lustre-OST0000 10000000:01000000:0.0:1787381587.066186:0:14804:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787381587.066189:0:14804:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787381587.066195:0:14804:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a16483d0000 local copy 00010000:00010000:0.0:1787381587.066205:0:14804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1647eb0800/0xbdc38ada7ea10961 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10968 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381587.066576:0:14804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542861880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14804:1874205065962112:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787381587.066611:0:14804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381587.066652:0:14804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fbac900 going to sleep for 11 seconds 00000100:00100000:1.0:1787381587.066767:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065962112 00000100:00100000:1.0:1787381587.066774:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065962112 00000100:00100000:1.0:1787381587.066821:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787381587.066830:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646541850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+12:14804:x1874205065962112:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787381587.066982:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646541850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+12:14804:x1874205065962112:12345-0@lo:501:mount.lustre.0 Request processed in 153us (370us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787381587.066989:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787381587.067096:0:14804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542861880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14804:1874205065962112:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787381587.067108:0:14804:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.122@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787381587.067303:0:14804:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.122@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787381587.067310:0:14804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1647eb0800/0xbdc38ada7ea10961 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10968 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381587.067320:0:14804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a1647eb0800/0xbdc38ada7ea10961 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10968 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787381587.067341:0:14804:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a1644e4b000 10000000:01000000:0.0:1787381587.067346:0:14804:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787381587.067350:0:14804:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9a16483d0000 10000000:01000000:0.0:1787381587.067352:0:14804:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787381587.067355:0:14804:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9a16483d0000 from 1 10000000:01000000:0.0:1787381587.067357:0:14804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787381587.067392:0:14804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a16460c8c00/0xbdc38ada7ea10a79 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381587.067400:0:14804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a16460c8c00/0xbdc38ada7ea10a79 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381587.067610:0:14804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a16460c8c00/0xbdc38ada7ea10a79 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381587.067639:0:14804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542861880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14804:1874205065962240:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787381587.067674:0:14804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381587.068405:0:14804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fbac900 going to sleep for 11 seconds 00000100:00100000:3.0:1787381587.068671:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065962240 00000100:00100000:3.0:1787381587.068680:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065962240 00000100:00100000:3.0:1787381587.068730:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787381587.068739:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646541450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+12:14804:x1874205065962240:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787381587.068751:0:14166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381587.068775:0:14166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1647eb1800/0xbdc38ada7ea10a80 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea10a79 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381587.068798:0:14166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1647eb1800/0xbdc38ada7ea10a80 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea10a79 expref: 13 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381587.068808:0:14166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1647eb1800/0xbdc38ada7ea10a80 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea10a79 expref: 13 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381587.068816:0:14166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb1800, rc 0) 00000100:00100000:3.0:1787381587.068874:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646541450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+13:14804:x1874205065962240:12345-0@lo:101:mount.lustre.0 Request processed in 136us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381587.068882:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787381587.068977:0:14804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542861880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14804:1874205065962240:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787381587.068991:0:14804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a16460c8c00/0xbdc38ada7ea10a79 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10a80 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381587.069000:0:14804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a16460c8c00/0xbdc38ada7ea10a79 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea10a80 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787381587.069048:0:14804:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787381587.069055:0:14804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a16460c8c00/0xbdc38ada7ea10a79 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10a80 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381587.069063:0:14804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a16460c8c00/0xbdc38ada7ea10a79 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10a80 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787381587.069070:0:14804:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787381587.069074:0:14804:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787381587.069079:0:14804:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787381587.069081:0:14804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787381587.069100:0:14804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a16413a0c00/0xbdc38ada7ea10a87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381587.069108:0:14804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a16413a0c00/0xbdc38ada7ea10a87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381587.069115:0:14804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a16413a0c00/0xbdc38ada7ea10a87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381587.069141:0:14804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14804:1874205065962368:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787381587.069179:0:14804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381587.069205:0:14804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16583d6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787381587.069354:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065962368 00000100:00100000:3.0:1787381587.069359:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065962368 00000100:00100000:3.0:1787381587.069398:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787381587.069405:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646540050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+13:14804:x1874205065962368:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787381587.069425:0:14164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381587.069435:0:14164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1647eb1000/0xbdc38ada7ea10a8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea10a87 expref: -99 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381587.069450:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1647eb1000/0xbdc38ada7ea10a8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea10a87 expref: 14 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381587.069459:0:14164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1647eb1000/0xbdc38ada7ea10a8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea10a87 expref: 14 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381587.069467:0:14164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb1000, rc 0) 00000100:00100000:3.0:1787381587.069504:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646540050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+14:14804:x1874205065962368:12345-0@lo:101:mount.lustre.0 Request processed in 99us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381587.069519:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787381587.069635:0:14804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14804:1874205065962368:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787381587.069646:0:14804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a16413a0c00/0xbdc38ada7ea10a87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10a8e expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381587.069654:0:14804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a16413a0c00/0xbdc38ada7ea10a87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea10a8e expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787381587.070338:0:14804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1787381587.071198:0:14804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787381587.071442:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1787381587.071487:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1787381587.071520:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1787381587.071564:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1787381587.071601:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1787381587.071637:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1787381587.071702:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1787381587.071710:0:14804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1787381587.071777:0:14804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542861880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14804:1874205065962496:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787381587.071832:0:14804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381587.071864:0:14804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fbac3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787381587.071946:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065962496 00000100:00100000:1.0:1787381587.071953:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065962496 00000100:00100000:1.0:1787381587.071985:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787381587.071994:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646541c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+14:14804:x1874205065962496:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787381587.072505:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646541c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+14:14804:x1874205065962496:12345-0@lo:501:mount.lustre.0 Request processed in 511us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381587.072514:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787381587.072878:0:14804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542861880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14804:1874205065962496:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787381587.073190:0:14804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14804:1874205065962624:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787381587.073241:0:14804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381587.073274:0:14804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a164b71f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787381587.073312:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065962624 00000100:00100000:0.0:1787381587.073318:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065962624 00000100:00100000:0.0:1787381587.073354:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787381587.073361:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646542850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+14:14804:x1874205065962624:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787381587.075508:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646542850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+14:14804:x1874205065962624:12345-0@lo:503:mount.lustre.0 Request processed in 2138us (2257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381587.075522:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787381587.075900:0:14804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14804:1874205065962624:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787381587.078811:0:14804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787381587.078906:0:14804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14804:1874205065962752:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787381587.078980:0:14804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381587.079046:0:14804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a164b71f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787381587.079268:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065962752 00000100:00100000:2.0:1787381587.079276:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065962752 00000100:00100000:2.0:1787381587.079328:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787381587.079338:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646543c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+14:14804:x1874205065962752:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787381587.079610:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646543c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+14:14804:x1874205065962752:12345-0@lo:502:mount.lustre.0 Request processed in 273us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381587.079619:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787381587.079923:0:14804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14804:1874205065962752:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787381587.080341:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787381587.080405:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787381587.080453:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787381587.080504:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787381587.080724:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787381587.080764:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787381587.080815:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787381587.080852:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787381587.080887:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1787381587.080937:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1787381587.080970:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1787381587.081039:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1787381587.081078:0:14804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14804:1874205065962880:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787381587.081146:0:14804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381587.081179:0:14804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a164b71f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787381587.081407:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065962880 00000100:00100000:2.0:1787381587.081423:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065962880 00000100:00100000:2.0:1787381587.081470:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787381587.081479:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646540850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+14:14804:x1874205065962880:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787381587.081665:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646540850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+14:14804:x1874205065962880:12345-0@lo:502:mount.lustre.0 Request processed in 187us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381587.081673:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787381587.081919:0:14804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14804:1874205065962880:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787381587.081993:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1787381587.082036:0:14804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1787381587.083622:0:14818:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787381587.083632:0:14818:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787381587.083639:0:14818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787381587.083641:0:14818:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787381587.083646:0:14818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787381587.083660:0:14818:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9a16765e4d40) 00000020:00000080:3.0:1787381587.083680:0:14818:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787381587.083685:0:14818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787381587.083816:0:14818:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a1644e4b000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787381587.083824:0:14818:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787381587.083832:0:14818:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xbdc38ada7ea10a9c 00010000:00010000:3.0:1787381587.092270:0:14818:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1787381587.094514:0:14818:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1787381587.098519:0:14818:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1787381587.100139:0:14818:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787381587.100152:0:14818:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787381587.100161:0:14818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787381587.100164:0:14818:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787381587.100168:0:14818:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787381587.100171:0:14818:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:0.0:1787381587.100173:0:14818:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787381587.100174:0:14818:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787381587.100176:0:14818:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787381587.100178:0:14818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787381587.100180:0:14818:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787381587.100182:0:14818:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787381587.100185:0:14818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787381587.100186:0:14818:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787381587.100189:0:14818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787381587.100192:0:14818:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787381587.100194:0:14818:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787381587.100196:0:14818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787381587.100197:0:14818:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787381587.100199:0:14818:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787381587.100202:0:14818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787381587.100203:0:14818:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787381587.100206:0:14818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787381587.100261:0:14818:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787381587.100265:0:14818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787381587.100266:0:14818:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787381587.100270:0:14818:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1787381587.100358:0:14804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1787381587.100397:0:14804:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787381587.100420:0:14804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a16413a0c00/0xbdc38ada7ea10a87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10a8e expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381587.100431:0:14804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a16413a0c00/0xbdc38ada7ea10a87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10a8e expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787381587.100439:0:14804:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a1644e4b000 from 1 10000000:01000000:2.0:1787381587.100441:0:14804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787381587.100484:0:14804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a16413a0800/0xbdc38ada7ea10aa3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381587.100492:0:14804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a16413a0800/0xbdc38ada7ea10aa3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381587.100502:0:14804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a16413a0800/0xbdc38ada7ea10aa3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381587.100525:0:14804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6c8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14804:1874205065963008:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787381587.100606:0:14804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381587.100646:0:14804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16583d6600 going to sleep for 11 seconds 00000100:00100000:3.0:1787381587.100773:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065963008 00000100:00100000:3.0:1787381587.100781:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065963008 00000100:00100000:3.0:1787381587.100864:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787381587.100875:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646541050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+14:14804:x1874205065963008:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787381587.100888:0:14164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381587.100899:0:14164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1647eb1600/0xbdc38ada7ea10aaa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea10aa3 expref: -99 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381587.100921:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1647eb1600/0xbdc38ada7ea10aaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea10aa3 expref: 15 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381587.100930:0:14164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1647eb1600/0xbdc38ada7ea10aaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea10aa3 expref: 15 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381587.100938:0:14164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb1600, rc 0) 00000100:00100000:3.0:1787381587.100985:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646541050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+15:14804:x1874205065963008:12345-0@lo:101:mount.lustre.0 Request processed in 111us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381587.100997:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787381587.101097:0:14804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6c8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14804:1874205065963008:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787381587.101110:0:14804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a16413a0800/0xbdc38ada7ea10aa3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10aaa expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381587.101124:0:14804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a16413a0800/0xbdc38ada7ea10aa3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea10aaa expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787381587.101628:0:14804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1787381587.102213:0:14804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787381587.102451:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1787381587.102488:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1787381587.102534:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1787381587.102541:0:14804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1787381587.102607:0:14804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542861880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14804:1874205065963136:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787381587.102655:0:14804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381587.110086:0:14804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fbaccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787381587.110260:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065963136 00000100:00100000:2.0:1787381587.110268:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065963136 00000100:00100000:2.0:1787381587.110312:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787381587.110321:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646540450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+15:14804:x1874205065963136:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787381587.110611:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646540450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+15:14804:x1874205065963136:12345-0@lo:501:mount.lustre.0 Request processed in 290us (7954us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381587.110619:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787381587.112850:0:14804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542861880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14804:1874205065963136:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787381587.112909:0:14804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542861880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14804:1874205065963264:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787381587.112985:0:14804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381587.113034:0:14804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fbaccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787381587.113230:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065963264 00000100:00100000:2.0:1787381587.113238:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065963264 00000100:00100000:2.0:1787381587.113278:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787381587.113288:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646542450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+15:14804:x1874205065963264:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787381587.113606:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646542450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+15:14804:x1874205065963264:12345-0@lo:503:mount.lustre.0 Request processed in 318us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381587.113614:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787381587.113854:0:14804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542861880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14804:1874205065963264:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787381587.116945:0:14804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787381587.117241:0:14804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14804:1874205065963392:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787381587.117317:0:14804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381587.117511:0:14804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a164b71f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787381587.117548:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065963392 00000100:00100000:2.0:1787381587.117554:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065963392 00000100:00100000:2.0:1787381587.117630:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787381587.117638:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+15:14804:x1874205065963392:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787381587.117851:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+15:14804:x1874205065963392:12345-0@lo:502:mount.lustre.0 Request processed in 212us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381587.117858:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787381587.118633:0:14804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14804:1874205065963392:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787381587.118876:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787381587.118930:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787381587.118980:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787381587.119108:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787381587.119228:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787381587.119273:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787381587.119306:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787381587.119629:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1787381587.119672:0:14804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14804:1874205065963520:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787381587.119735:0:14804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381587.119822:0:14804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a164b71f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787381587.119901:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065963520 00000100:00100000:2.0:1787381587.119908:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065963520 00000100:00100000:2.0:1787381587.120080:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787381587.120090:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646543050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+15:14804:x1874205065963520:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787381587.120280:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646543050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+15:14804:x1874205065963520:12345-0@lo:502:mount.lustre.0 Request processed in 191us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381587.120288:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787381587.120363:0:14804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14804:1874205065963520:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787381587.120482:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1787381587.120494:0:14804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1787381587.125585:0:14822:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787381587.125601:0:14822:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787381587.125603:0:14822:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787381587.125612:0:14822:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a1644e4b000 00000020:00000080:2.0:1787381587.125615:0:14822:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787381587.125622:0:14822:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787381587.125625:0:14822:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787381587.125626:0:14822:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787381587.125628:0:14822:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787381587.125630:0:14822:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787381587.125632:0:14822:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787381587.125635:0:14822:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a1644e4b000 00000020:00000080:2.0:1787381587.125636:0:14822:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787381587.125743:0:14822:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787381587.125748:0:14822:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787381587.125749:0:14822:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787381587.125752:0:14822:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787381587.125754:0:14822:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787381587.125767:0:14822:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787381587.125771:0:14822:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a1644e4b000 00000020:00000080:2.0:1787381587.125773:0:14822:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787381587.127848:0:14822:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787381587.127859:0:14822:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787381587.127861:0:14822:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787381587.127867:0:14822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1787381587.140829:0:14804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787381587.140870:0:14804:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787381587.140894:0:14804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a16413a0800/0xbdc38ada7ea10aa3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10aaa expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381587.140906:0:14804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a16413a0800/0xbdc38ada7ea10aa3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10aaa expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787381587.140996:0:14804:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787381587.140999:0:14804:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a1644e4b000 10000000:01000000:1.0:1787381587.141017:0:14804:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a1644e4b000 10000000:01000000:1.0:1787381587.141022:0:14804:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787381587.141027:0:14804:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a1644e4b000 from 1 10000000:01000000:1.0:1787381587.141029:0:14804:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787381587.141063:0:14804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1541389a00/0xbdc38ada7ea10ab1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381587.141072:0:14804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a1541389a00/0xbdc38ada7ea10ab1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381587.141081:0:14804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a1541389a00/0xbdc38ada7ea10ab1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381587.141106:0:14804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14804:1874205065963648:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787381587.141182:0:14804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381587.141219:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065963648 00000100:00100000:1.0:1787381587.141226:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065963648 00000100:00100000:1.0:1787381587.141267:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787381587.141275:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1650861450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+15:14804:x1874205065963648:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787381587.141289:0:14164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381587.141301:0:14164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1541389000/0xbdc38ada7ea10ab8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea10ab1 expref: -99 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381587.141323:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1541389000/0xbdc38ada7ea10ab8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea10ab1 expref: 16 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381587.141333:0:14164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1541389000/0xbdc38ada7ea10ab8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea10ab1 expref: 16 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381587.141341:0:14164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541389000, rc 0) 00000100:00100000:1.0:1787381587.141374:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1650861450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+16:14804:x1874205065963648:12345-0@lo:101:mount.lustre.0 Request processed in 99us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381587.141392:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787381587.141434:0:14804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a164b71f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787381587.141455:0:14804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14804:1874205065963648:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787381587.141466:0:14804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a1541389a00/0xbdc38ada7ea10ab1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10ab8 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381587.141475:0:14804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a1541389a00/0xbdc38ada7ea10ab1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea10ab8 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787381587.142078:0:14804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1787381587.142392:0:14804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787381587.142644:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787381587.142687:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787381587.142734:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787381587.142783:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787381587.142820:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787381587.142870:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787381587.142906:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787381587.142939:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787381587.142984:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787381587.143042:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787381587.143076:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787381587.143132:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787381587.143171:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787381587.143204:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787381587.143254:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787381587.143291:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787381587.143325:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787381587.143375:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787381587.143440:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787381587.143477:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787381587.143527:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787381587.143565:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787381587.143600:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787381587.143650:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787381587.143686:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1787381587.143717:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1787381587.143763:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1787381587.143796:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1787381587.143870:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1787381587.143878:0:14804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1787381587.143969:0:14804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14804:1874205065963776:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787381587.144061:0:14804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381587.144096:0:14804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a164b71f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787381587.144186:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065963776 00000100:00100000:2.0:1787381587.144192:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065963776 00000100:00100000:2.0:1787381587.144239:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787381587.144248:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1650860c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+16:14804:x1874205065963776:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787381587.144461:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1650860c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+16:14804:x1874205065963776:12345-0@lo:501:mount.lustre.0 Request processed in 213us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381587.144469:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787381587.148286:0:14804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14804:1874205065963776:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787381587.148341:0:14804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14804:1874205065963904:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787381587.148606:0:14804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381587.148650:0:14804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a164b71f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787381587.148700:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065963904 00000100:00100000:3.0:1787381587.148706:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065963904 00000100:00100000:2.0:1787381587.156958:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787381587.156983:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1650861c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+16:14804:x1874205065963904:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787381587.157275:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1650861c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+16:14804:x1874205065963904:12345-0@lo:503:mount.lustre.0 Request processed in 302us (8668us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381587.157303:0:14804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14804:1874205065963904:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787381587.157794:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000040:00080000:1.0:1787381587.157880:0:14804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787381587.157958:0:14804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14804:1874205065964032:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787381587.158047:0:14804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381587.158087:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065964032 00000100:00100000:1.0:1787381587.158093:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065964032 00000100:00100000:1.0:1787381587.158134:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787381587.158141:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1650863c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+16:14804:x1874205065964032:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787381587.158337:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1650863c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+16:14804:x1874205065964032:12345-0@lo:502:mount.lustre.0 Request processed in 195us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381587.158344:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787381587.158400:0:14804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16505cf180 going to sleep for 11 seconds 00000100:00100000:1.0:1787381587.158416:0:14804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14804:1874205065964032:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787381587.158660:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787381587.158734:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787381587.158769:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787381587.158815:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787381587.158846:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787381587.158898:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787381587.158936:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787381587.158982:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787381587.159060:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787381587.159107:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787381587.159136:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787381587.159179:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787381587.159206:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787381587.159242:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787381587.159287:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787381587.159328:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787381587.159362:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787381587.161071:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787381587.161142:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787381587.161454:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787381587.161523:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787381587.161562:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787381587.161608:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787381587.161676:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787381587.161721:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1787381587.161755:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1787381587.161802:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1787381587.161836:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1787381587.161879:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1787381587.161951:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1787381587.162136:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1787381587.162319:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1787381587.162362:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1787381587.162441:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1787381587.162479:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1787381587.162543:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1787381587.162590:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1787381587.162632:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1787381587.162689:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1787381587.162746:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1787381587.162807:0:14804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14804:1874205065964160:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787381587.163031:0:14804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381587.163073:0:14804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16505cf180 going to sleep for 11 seconds 00000100:00100000:3.0:1787381587.164528:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065964160 00000100:00100000:3.0:1787381587.164543:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065964160 00000100:00100000:3.0:1787381587.164604:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787381587.164616:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16799c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+16:14804:x1874205065964160:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787381587.164933:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16799c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+16:14804:x1874205065964160:12345-0@lo:502:mount.lustre.0 Request processed in 319us (1901us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381587.164940:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787381587.164993:0:14804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14804:1874205065964160:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787381587.165119:0:14804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1787381587.165133:0:14804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1787381587.171792:0:14827:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787381587.171810:0:14827:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9a16461319c0) 00000020:00000080:0.0:1787381587.171832:0:14827:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1787381587.171982:0:14827:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a1644e4b000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787381587.171987:0:14827:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a1644e4b000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787381587.171994:0:14827:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a1644e4b000 3 00010000:00080000:0.0:1787381587.172070:0:14827:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a154237b800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.122@tcp at head 00010000:00010000:0.0:1787381587.181467:0:14827:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1787381587.181578:0:14827:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787381587.181615:0:14827:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787381587.181626:0:14827:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xbdc38ada7ea10ac6 00000100:00080000:0.0:1787381587.181635:0:14827:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787381587.181640:0:14827:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a154237b800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:0.0:1787381587.181673:0:14827:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a1542861880 x1874205065964288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787381587.182047:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542861880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1874205065964288:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787381587.182113:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381587.182231:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065964288 00000100:00100000:0.0:1787381587.182239:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065964288 00000100:00100000:0.0:1787381587.182271:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787381587.182278:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542862680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1874205065964288:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787381587.182301:0:14171:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 445 last 0 00000020:00000080:0.0:1787381587.182332:0:14171:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xbdc38ada7ea10acd 00000004:00100000:0.0:1787381587.182349:0:14171:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787381587.182388:0:14171:0:(import.c:65:import_set_state_nolock()) ffff9a154237a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787381587.182486:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542862680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874205065964288:12345-0@lo:38:llog_process_th.0 Request processed in 206us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381587.182493:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787381587.182512:0:14827:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787381587.182804:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787381587.182810:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787381587.182886:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787381587.182889:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787381587.182938:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542862a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874205065964416:0@lo:400:kworker.0 00000100:00100000:0.0:1787381587.182976:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381587.183034:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065964416 00000100:00100000:0.0:1787381587.183039:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065964416 00000100:00100000:0.0:1787381587.183070:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787381587.183077:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542861f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874205065964416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381587.183114:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542861f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874205065964416:12345-0@lo:400:kworker.0 Request processed in 37us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381587.183121:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787381587.183151:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a1542862a00 x1874205065964416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787381603 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381587.183238:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542862a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874205065964416:0@lo:400:kworker.0 00000040:00080000:0.0:1787381587.185952:0:14827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00010000:00080000:3.0:1787381587.186678:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a1542861880 x1874205065964288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787381597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787381587.186692:0:3307:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787381587.186701:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1787381587.186709:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787381587.186714:0:3307:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787381587.186718:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9a154237b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787381587.186725:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542861880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1874205065964288:0@lo:38:llog_process_th.0 00000020:01000000:1.0:1787381587.186985:0:14804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787381587.189344:0:14804:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787381587.189875:0:14804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1541389a00/0xbdc38ada7ea10ab1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10ab8 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381587.189888:0:14804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a1541389a00/0xbdc38ada7ea10ab1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10ab8 expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787381587.189944:0:14804:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787381587.189946:0:14804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787381587.189947:0:14804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787381587.189948:0:14804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787381587.189949:0:14804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787381587.189951:0:14804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787381587.189952:0:14804:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787381587.189954:0:14804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787381587.189955:0:14804:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787381587.189959:0:14804:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1787381587.189962:0:14804:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787381587.189963:0:14804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787381587.189964:0:14804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787381587.189965:0:14804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787381587.189966:0:14804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787381587.189967:0:14804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787381587.189968:0:14804:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787381587.189969:0:14804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787381587.189970:0:14804:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787381587.189995:0:14804:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787381587.190039:0:14804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14804:1874205065964544:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787381587.190110:0:14804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381587.190143:0:14804:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16505cfa80 going to sleep for 11 seconds 00000100:00100000:1.0:1787381587.190173:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065964544 00000100:00100000:1.0:1787381587.190179:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065964544 00000100:00100000:1.0:1787381587.190221:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787381587.190229:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16799cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+16:14804:x1874205065964544:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787381587.190266:0:14164:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787381587.190280:0:14164:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787381587.223919:0:14164:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787381587.223938:0:14164:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787381587.223954:0:14187:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787381587.223958:0:14187:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787381587.223981:0:14187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a16460c8800/0xbdc38ada7ea10ad4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381587.224001:0:14187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a1541388a00/0xbdc38ada7ea10a41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea10a3a expref: 16 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381587.224101:0:14187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a16460c8800/0xbdc38ada7ea10ad4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381587.224143:0:14187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a1541388a00/0xbdc38ada7ea10a41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbdc38ada7ea10a3a expref: 16 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381587.224171:0:14187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a1541388a00/0xbdc38ada7ea10a41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbdc38ada7ea10a3a expref: 16 pid: 14165 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381587.224187:0:14187:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542862a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14187:1874205065964672:0@lo:104: 00000100:00100000:0.0:1787381587.224254:0:14187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381587.224297:0:14187:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fbac0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787381587.224365:0:14154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065964672 00000100:00100000:2.0:1787381587.224373:0:14154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065964672 00000100:00100000:2.0:1787381587.224674:0:14154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787381587.224684:0:14154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542862d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+3:14187:x1874205065964672:12345-0@lo:104: 00010000:00010000:2.0:1787381587.224697:0:14154:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1400/0xbdc38ada7ea10a3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea10a41 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381587.224763:0:14154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787381587.224770:0:14154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542862d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+3:14187:x1874205065964672:12345-0@lo:104: Request processed in 88us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381587.224784:0:14154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787381587.224858:0:14187:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542862a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14187:1874205065964672:0@lo:104: 00010000:00010000:1.0:1787381587.224875:0:14187:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a16460c8800/0xbdc38ada7ea10ad4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381587.224890:0:14159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787381587.224895:0:14159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1400/0xbdc38ada7ea10a3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea10a41 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381587.224901:0:14159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb1400 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:1.0:1787381587.224905:0:14159:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1400/0xbdc38ada7ea10a3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbdc38ada7ea10a41 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381587.224912:0:14159:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1400/0xbdc38ada7ea10a3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbdc38ada7ea10a41 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787381587.224918:0:14159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1400/0xbdc38ada7ea10a3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbdc38ada7ea10a41 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787381587.224923:0:14159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787381587.224955:0:14159:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1400/0xbdc38ada7ea10a3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea10a41 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381587.224961:0:14159:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787381587.224985:0:14159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1400/0xbdc38ada7ea10a3a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea10a41 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381587.224991:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1400/0xbdc38ada7ea10a3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea10a41 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381587.225027:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381587.225029:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787381587.225030:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:3310:1874205065964800:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787381587.225031:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787381587.225062:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381587.225150:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065964800 00000100:00100000:1.0:1787381587.225155:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065964800 00010000:00010000:1.0:1787381587.225171:0:14158:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a1541388a00/0xbdc38ada7ea10a41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea10a3a expref: 17 pid: 14165 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381587.225202:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787381587.225208:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+17:3310:x1874205065964800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787381587.225217:0:14158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381587.225222:0:14158:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a1541388a00/0xbdc38ada7ea10a41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea10a3a expref: 17 pid: 14165 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381587.225232:0:14158:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a1541388a00/0xbdc38ada7ea10a41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbdc38ada7ea10a3a expref: 17 pid: 14165 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381587.225244:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1541388a00/0xbdc38ada7ea10a41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbdc38ada7ea10a3a expref: 17 pid: 14165 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381587.225255:0:14158:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a16460c8800/0xbdc38ada7ea10ad4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381587.225269:0:14158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a16460c8800/0xbdc38ada7ea10ad4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787381587.225281:0:14158:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008067035s 00010000:00010000:1.0:1787381587.225285:0:14158:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a16460c8800/0xbdc38ada7ea10ad4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381587.225291:0:14158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a16460c8800/0xbdc38ada7ea10ad4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381587.225297:0:14158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a16460c8800/0xbdc38ada7ea10ad4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381587.225303:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a16460c8800/0xbdc38ada7ea10ad4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381587.225308:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c8800 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:1.0:1787381587.225312:0:14158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a16460c8800/0xbdc38ada7ea10ad4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381587.225319:0:14158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a16460c8800/0xbdc38ada7ea10ad4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381587.225331:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a16460c8800/0xbdc38ada7ea10ad4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381587.225340:0:14158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381587.225367:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+16:3310:x1874205065964800:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381587.225374:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787381587.225409:0:14187:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a16460c8800/0xbdc38ada7ea10ad4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381587.225417:0:14187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a16460c8800/0xbdc38ada7ea10ad4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381587.225423:0:14187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a16460c8800/0xbdc38ada7ea10ad4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381587.225469:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:3310:1874205065964800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787381587.247305:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16799cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+15:14804:x1874205065964544:12345-0@lo:253:mount.lustre.0 Request processed in 57067us (57185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381587.247321:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787381587.247692:0:14804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14804:1874205065964544:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787381587.247708:0:14804:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787381587.247711:0:14804:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787381587.247713:0:14804:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787381587.247714:0:14804:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787381587.247715:0:14804:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787381587.247717:0:14804:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787381587.247718:0:14804:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787381587.247720:0:14804:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787381587.247721:0:14804:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787381587.247723:0:14804:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787381587.247742:0:14804:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787381587.256347:0:14804:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787381587.256548:0:14804:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787381587.256716:0:14804:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787381587.256878:0:14804:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787381587.257034:0:14804:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787381587.257411:0:14804:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787381587.258490:0:14804:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1787381587.289032:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1787381587.341709:0:14804:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787381587.341718:0:14804:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787381587.341749:0:14804:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787381587.345323:0:14804:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.122@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787381587.345351:0:14804:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787381587.345397:0:14804:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00000040:00080000:1.0:1787381587.724541:0:14205:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1787381588.242995:0:14169:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787381588.243132:0:14169:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a15411ca800 from 7 10000000:01000000:0.0:1787381588.243137:0:14169:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787381588.243183:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a16460c8e00/0xbdc38ada7ea10adb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381588.243197:0:14169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a16460c8e00/0xbdc38ada7ea10adb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381588.243209:0:14169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a16460c8e00/0xbdc38ada7ea10adb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381588.243233:0:14169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542863480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14169:1874205065964928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787381588.243301:0:14169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381588.243409:0:14169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fe15780 going to sleep for 11 seconds 00000100:00100000:3.0:1787381588.245865:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065964928 00000100:00100000:3.0:1787381588.245879:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065964928 00000100:00100000:3.0:1787381588.246927:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787381588.246942:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16799c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+15:14169:x1874205065964928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787381588.246959:0:14166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381588.246977:0:14166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1647eb0c00/0xbdc38ada7ea10ae2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea10adb expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381588.247029:0:14166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1647eb0c00/0xbdc38ada7ea10ae2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea10adb expref: 16 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381588.247041:0:14166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1647eb0c00/0xbdc38ada7ea10ae2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea10adb expref: 16 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381588.247050:0:14166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb0c00, rc 0) 00000100:00100000:3.0:1787381588.247977:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16799c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+16:14169:x1874205065964928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1036us (4672us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381588.247987:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787381588.248940:0:14169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542863480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14169:1874205065964928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787381588.248965:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a16460c8e00/0xbdc38ada7ea10adb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10ae2 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381588.248989:0:14169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a16460c8e00/0xbdc38ada7ea10adb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea10ae2 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381588.249072:0:14169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542863480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14169:1874205065965056:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787381588.249133:0:14169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381588.252979:0:14169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fe15780 going to sleep for 11 seconds 00000100:00100000:2.0:1787381588.255994:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065965056 00000100:00100000:2.0:1787381588.256033:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065965056 00000100:00100000:2.0:1787381588.256090:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787381588.256101:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16799ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+16:14169:x1874205065965056:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787381588.256126:0:14165:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787381588.256151:0:14165:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787381588.256154:0:14165:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1787381588.256295:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16799ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+16:14169:x1874205065965056:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 195us (7171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381588.256304:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787381588.265091:0:14169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542863480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14169:1874205065965056:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787381588.265169:0:14169:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787381588.265178:0:14169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a16460c8e00/0xbdc38ada7ea10adb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10ae2 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381588.265189:0:14169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a16460c8e00/0xbdc38ada7ea10adb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10ae2 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381588.306082:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381589.327267:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381590.351800:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381591.373547:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787381592.396170:0:2586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787381592.396176:0:2586:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787381592.396179:0:2586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787381592.396181:0:2586:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787381592.396335:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:3311:1874205065965184:0@lo:400:kworker.0 00000100:00100000:3.0:1787381592.396417:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381592.396492:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874205065965312:0@lo:400:kworker.0 00000100:00100000:3.0:1787381592.396535:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381592.396558:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787381592.396564:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1874205065965440:0@lo:400:kworker.0 00000100:00100000:3.0:1787381592.396583:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381592.396612:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065965184 00000100:00100000:3.0:1787381592.396619:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065965184 00000100:00100000:3.0:1787381592.396659:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787381592.396667:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16799c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+16:3311:x1874205065965184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787381592.396714:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16799c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+16:3311:x1874205065965184:12345-0@lo:400:kworker.0 Request processed in 47us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381592.396721:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787381592.396751:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065965312 00000100:00100000:3.0:1787381592.396755:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065965312 00000100:00100000:3.0:1787381592.396777:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065965440 00000100:00100000:3.0:1787381592.396780:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065965440 00000100:00100000:3.0:1787381592.396803:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787381592.396809:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874205065965312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787381592.396843:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874205065965312:12345-0@lo:400:kworker.0 Request processed in 34us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381592.396849:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787381592.396860:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787381592.396866:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874205065965440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787381592.396893:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874205065965440:12345-0@lo:400:kworker.0 Request processed in 27us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381592.396898:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787381592.396929:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:3311:1874205065965184:0@lo:400:kworker.0 00010000:00080000:3.0:1787381592.396975:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a167f59d880 x1874205065965440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787381608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787381592.396985:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1874205065965440:0@lo:400:kworker.0 00010000:00080000:3.0:1787381592.396994:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a167f59f800 x1874205065965312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787381608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787381592.397001:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874205065965312:0@lo:400:kworker.0 00010000:00010000:1.0:1787381592.397099:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787381592.398476:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1787381593.377000:0:15174:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787381593.420435:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381594.447437:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381595.468305:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381596.492160:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381597.517828:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787381597.517975:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787381597.517980:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787381597.517983:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787381597.517994:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787381597.518062:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:3310:1874205065965568:0@lo:400:kworker.0 00000100:00100000:1.0:1787381597.518392:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381597.518444:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787381597.518451:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874205065965696:0@lo:400:kworker.0 00000100:00100000:1.0:1787381597.518484:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381597.518512:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787381597.518520:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1874205065965824:0@lo:400:kworker.0 00000100:00100000:1.0:1787381597.518546:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381597.518573:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065965568 00000100:00100000:1.0:1787381597.518580:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065965568 00000100:00100000:1.0:1787381597.518623:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787381597.518631:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16799c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+16:3310:x1874205065965568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381597.518679:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16799c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+16:3310:x1874205065965568:12345-0@lo:400:kworker.0 Request processed in 48us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381597.518687:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787381597.518720:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065965696 00000100:00100000:1.0:1787381597.518723:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065965696 00000100:00100000:1.0:1787381597.518743:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065965824 00000100:00100000:1.0:1787381597.518745:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065965824 00000100:00100000:1.0:1787381597.518765:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787381597.518770:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874205065965696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381597.518797:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874205065965696:12345-0@lo:400:kworker.0 Request processed in 27us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381597.518803:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787381597.518813:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787381597.518827:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874205065965824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381597.518859:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874205065965824:12345-0@lo:400:kworker.0 Request processed in 33us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381597.518865:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787381597.518892:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787381597.518916:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a167a6f4700 x1874205065965824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787381613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381597.518928:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1874205065965824:0@lo:400:kworker.0 00010000:00080000:1.0:1787381597.518953:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a167a6f4380 x1874205065965696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787381613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381597.518963:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874205065965696:0@lo:400:kworker.0 00000100:00100000:1.0:1787381597.518970:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:3310:1874205065965568:0@lo:400:kworker.0 00000040:00080000:3.0:1787381597.964722:0:14205:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787381598.548112:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787381599.501782:0:15475:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787381599.501786:0:15475:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1787381599.501903:0:15475:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a1646075800 00000020:01000004:1.0:1787381599.501917:0:15475:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787381599.501930:0:15475:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1787381599.501944:0:15475:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9a16464699c0) 00000020:00000080:1.0:1787381599.501960:0:15475:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787381599.518621:0:15475:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787381599.519485:0:15475:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787381599.520249:0:15475:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787381599.520491:0:15475:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787381599.520705:0:15475:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787381599.521062:0:15475:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 357: rc = 0 00100000:10000000:2.0:1787381599.521156:0:15475:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 357: rc = 0 00100000:10000000:2.0:1787381599.521312:0:15475:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 357: rc = 0 00100000:10000000:2.0:1787381599.521815:0:15475:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 640: rc = 0 00100000:10000000:2.0:1787381599.522111:0:15475:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 640: rc = 0 00100000:10000000:2.0:1787381599.524583:0:15475:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 640: rc = 0 00100000:10000000:2.0:1787381599.525090:0:15475:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 640: rc = 0 00100000:10000000:2.0:1787381599.525844:0:15475:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 640: rc = 0 00100000:10000000:2.0:1787381599.526829:0:15475:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 640: rc = 0 00000020:00000080:2.0:1787381599.527909:0:15475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787381599.527921:0:15475:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787381599.527931:0:15475:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbdc38ada7ea10af0 00000020:01000004:2.0:1787381599.527938:0:15475:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787381599.527959:0:15475:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.122@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787381599.527963:0:15475:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.122@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787381599.527969:0:15475:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787381599.527990:0:15475:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787381599.527994:0:15475:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.122@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787381599.546138:0:15475:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.122@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787381599.546704:0:15475:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.122@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1787381599.546709:0:15475:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787381599.546711:0:15475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787381599.546712:0:15475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787381599.546714:0:15475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787381599.546715:0:15475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787381599.546716:0:15475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787381599.546718:0:15475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787381599.546719:0:15475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787381599.546721:0:15475:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787381599.546724:0:15475:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1787381599.546727:0:15475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787381599.546728:0:15475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787381599.546729:0:15475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787381599.546730:0:15475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787381599.546731:0:15475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787381599.546732:0:15475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787381599.546739:0:15475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787381599.546740:0:15475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787381599.546741:0:15475:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787381599.546767:0:15475:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787381599.546787:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:15475:1874205065965952:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787381599.546859:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381599.546958:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f5b3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787381599.547023:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065965952 00000100:00100000:0.0:1787381599.547031:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065965952 00000100:00100000:0.0:1787381599.548602:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787381599.548617:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16799c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+16:15475:x1874205065965952:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787381599.548652:0:14166:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787381599.548655:0:14166:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1787381599.548659:0:14166:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787381599.559414:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16799c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+16:15475:x1874205065965952:12345-0@lo:253:mount.lustre.0 Request processed in 10794us (12547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381599.559429:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787381599.559662:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:15475:1874205065965952:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787381599.559676:0:15475:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787381599.559679:0:15475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787381599.559681:0:15475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787381599.559682:0:15475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787381599.559683:0:15475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787381599.559684:0:15475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787381599.559685:0:15475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787381599.559687:0:15475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787381599.559689:0:15475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787381599.559690:0:15475:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787381599.559713:0:15475:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a1646075800 from lustre-OST0001 10000000:01000000:3.0:1787381599.559737:0:15475:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787381599.559740:0:15475:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787381599.559746:0:15475:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a16483d0000 local copy 00010000:00010000:3.0:1787381599.559756:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1647eb0800/0xbdc38ada7ea10961 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10968 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381599.560116:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:15475:1874205065966080:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787381599.560155:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381599.560238:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f5b3240 going to sleep for 11 seconds 00000100:00100000:1.0:1787381599.560288:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065966080 00000100:00100000:1.0:1787381599.560303:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065966080 00000100:00100000:1.0:1787381599.560397:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787381599.560406:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16799cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+16:15475:x1874205065966080:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787381599.560595:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16799cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+16:15475:x1874205065966080:12345-0@lo:501:mount.lustre.0 Request processed in 189us (438us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787381599.560613:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787381599.560677:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:15475:1874205065966080:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787381599.560690:0:15475:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.122@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787381599.560825:0:15475:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.122@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787381599.560836:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1647eb0800/0xbdc38ada7ea10961 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10968 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381599.560846:0:15475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a1647eb0800/0xbdc38ada7ea10961 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10968 expref: -99 pid: 14153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787381599.560866:0:15475:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a1646075800 10000000:01000000:3.0:1787381599.560871:0:15475:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787381599.560875:0:15475:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787381599.560877:0:15475:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787381599.560881:0:15475:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787381599.560896:0:15475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787381599.560919:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1647eb0a00/0xbdc38ada7ea10af7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381599.560927:0:15475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a1647eb0a00/0xbdc38ada7ea10af7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381599.560936:0:15475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a1647eb0a00/0xbdc38ada7ea10af7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381599.560948:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:15475:1874205065966208:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787381599.560974:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381599.561803:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f5b3240 going to sleep for 11 seconds 00000100:00100000:0.0:1787381599.561941:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065966208 00000100:00100000:0.0:1787381599.561957:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065966208 00000100:00100000:0.0:1787381599.561988:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787381599.561995:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16799cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+16:15475:x1874205065966208:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787381599.562020:0:14164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381599.562035:0:14164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a16460c9200/0xbdc38ada7ea10afe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea10af7 expref: -99 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381599.562058:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a16460c9200/0xbdc38ada7ea10afe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea10af7 expref: 17 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381599.562069:0:14164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a16460c9200/0xbdc38ada7ea10afe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea10af7 expref: 17 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381599.562077:0:14164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16460c9200, rc 0) 00000100:00100000:0.0:1787381599.562128:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16799cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+17:15475:x1874205065966208:12345-0@lo:101:mount.lustre.0 Request processed in 133us (1152us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381599.562134:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787381599.562259:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:15475:1874205065966208:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787381599.562275:0:15475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a1647eb0a00/0xbdc38ada7ea10af7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10afe expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381599.562285:0:15475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a1647eb0a00/0xbdc38ada7ea10af7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea10afe expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787381599.563156:0:15475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787381599.564847:0:15475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787381599.565342:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787381599.565655:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787381599.565697:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787381599.565750:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787381599.565787:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787381599.565823:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787381599.566136:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787381599.566144:0:15475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787381599.566242:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:15475:1874205065966336:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787381599.566318:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381599.566365:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f5b3000 going to sleep for 11 seconds 00010000:00010000:0.0:1787381599.566583:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787381599.566652:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065966336 00000100:00100000:1.0:1787381599.566660:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065966336 00000100:00100000:1.0:1787381599.566698:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787381599.566706:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16799c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+17:15475:x1874205065966336:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787381599.567736:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16799c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+17:15475:x1874205065966336:12345-0@lo:501:mount.lustre.0 Request processed in 1026us (1414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381599.567746:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787381599.567833:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:15475:1874205065966336:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787381599.567878:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:15475:1874205065966464:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787381599.571439:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381599.571493:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f5b3000 going to sleep for 11 seconds 00000100:00100000:2.0:1787381599.571576:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065966464 00000100:00100000:2.0:1787381599.571585:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065966464 00000100:00100000:2.0:1787381599.571676:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787381599.571686:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16799cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+17:15475:x1874205065966464:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787381599.572645:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16799cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+17:15475:x1874205065966464:12345-0@lo:503:mount.lustre.0 Request processed in 957us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381599.572655:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787381599.573223:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:15475:1874205065966464:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787381599.575534:0:15475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787381599.575621:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:15475:1874205065966592:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787381599.575702:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381599.576614:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f5b3000 going to sleep for 11 seconds 00000100:00100000:2.0:1787381599.577175:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065966592 00000100:00100000:2.0:1787381599.577184:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065966592 00000100:00100000:3.0:1787381599.577432:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787381599.577442:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16799c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+17:15475:x1874205065966592:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787381599.577807:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16799c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+17:15475:x1874205065966592:12345-0@lo:502:mount.lustre.0 Request processed in 366us (2105us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381599.578101:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787381599.578169:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:15475:1874205065966592:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787381599.578500:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787381599.578557:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787381599.578588:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787381599.578634:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787381599.578673:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787381599.578709:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787381599.578911:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787381599.578966:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787381599.579114:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1787381599.579154:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542863480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:15475:1874205065966720:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787381599.579224:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381599.579576:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fe15f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787381599.579660:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065966720 00000100:00100000:2.0:1787381599.579666:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065966720 00000100:00100000:2.0:1787381599.579703:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787381599.579712:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+17:15475:x1874205065966720:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787381599.579929:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+17:15475:x1874205065966720:12345-0@lo:502:mount.lustre.0 Request processed in 217us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381599.579936:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787381599.580184:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542863480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:15475:1874205065966720:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787381599.580277:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1787381599.580288:0:15475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1787381599.581448:0:15476:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787381599.581459:0:15476:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1787381599.581466:0:15476:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787381599.581468:0:15476:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787381599.581474:0:15476:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787381599.581489:0:15476:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9a1646130000) 00000020:00000080:0.0:1787381599.581509:0:15476:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787381599.581514:0:15476:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787381599.581584:0:15476:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a1646075800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787381599.581592:0:15476:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787381599.581599:0:15476:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xbdc38ada7ea10b0c 00010000:00010000:0.0:1787381599.591496:0:15476:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1787381599.591902:0:15476:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1787381599.598328:0:15476:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1787381599.599878:0:15476:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787381599.599890:0:15476:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787381599.599897:0:15476:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787381599.599899:0:15476:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787381599.599903:0:15476:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787381599.599908:0:15476:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787381599.599910:0:15476:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787381599.599913:0:15476:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787381599.599914:0:15476:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787381599.599916:0:15476:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787381599.599928:0:15476:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787381599.599930:0:15476:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787381599.599933:0:15476:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787381599.599936:0:15476:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787381599.599937:0:15476:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787381599.599940:0:15476:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787381599.599997:0:15476:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787381599.600000:0:15476:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787381599.600032:0:15476:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787381599.600036:0:15476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1787381599.600253:0:15475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1787381599.600282:0:15475:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787381599.600308:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1647eb0a00/0xbdc38ada7ea10af7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10afe expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381599.600320:0:15475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a1647eb0a00/0xbdc38ada7ea10af7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10afe expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787381599.600329:0:15475:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a1646075800 from 1 10000000:01000000:0.0:1787381599.600332:0:15475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787381599.600365:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a16460c9e00/0xbdc38ada7ea10b13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381599.600381:0:15475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a16460c9e00/0xbdc38ada7ea10b13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381599.600392:0:15475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a16460c9e00/0xbdc38ada7ea10b13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381599.600412:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542863480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:15475:1874205065966848:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787381599.600487:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381599.600521:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fe15480 going to sleep for 11 seconds 00000100:00100000:2.0:1787381599.602985:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065966848 00000100:00100000:2.0:1787381599.602996:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065966848 00000100:00100000:2.0:1787381599.603179:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787381599.603189:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+17:15475:x1874205065966848:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787381599.603206:0:14165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381599.603223:0:14165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a16413a0600/0xbdc38ada7ea10b1a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea10b13 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381599.603261:0:14165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a16413a0600/0xbdc38ada7ea10b1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea10b13 expref: 18 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381599.603272:0:14165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a16413a0600/0xbdc38ada7ea10b1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea10b13 expref: 18 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381599.603281:0:14165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16413a0600, rc 0) 00000100:00100000:2.0:1787381599.603372:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+18:15475:x1874205065966848:12345-0@lo:101:mount.lustre.0 Request processed in 183us (2884us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381599.603379:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787381599.603466:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542863480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:15475:1874205065966848:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787381599.603483:0:15475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a16460c9e00/0xbdc38ada7ea10b13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10b1a expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381599.603492:0:15475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a16460c9e00/0xbdc38ada7ea10b13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea10b1a expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787381599.604055:0:15475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787381599.604449:0:15475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787381599.604667:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787381599.604707:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787381599.604760:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787381599.604766:0:15475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787381599.604824:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:15475:1874205065966976:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787381599.604874:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381599.608424:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065966976 00000100:00100000:0.0:1787381599.608437:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065966976 00000100:00100000:1.0:1787381599.608475:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f5379c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787381599.608648:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787381599.608738:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+18:15475:x1874205065966976:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787381599.609058:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+18:15475:x1874205065966976:12345-0@lo:501:mount.lustre.0 Request processed in 335us (4181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381599.609067:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787381599.610836:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:15475:1874205065966976:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787381599.610894:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:15475:1874205065967104:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787381599.610972:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381599.611033:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f5379c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787381599.611190:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065967104 00000100:00100000:3.0:1787381599.611197:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065967104 00000100:00100000:3.0:1787381599.611250:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787381599.611258:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+18:15475:x1874205065967104:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787381599.611473:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+18:15475:x1874205065967104:12345-0@lo:503:mount.lustre.0 Request processed in 214us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381599.611481:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787381599.611637:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:15475:1874205065967104:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787381599.613786:0:15475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787381599.613877:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542860a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:15475:1874205065967232:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787381599.613946:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381599.613988:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167fe156c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787381599.614050:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065967232 00000100:00100000:3.0:1787381599.614057:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065967232 00000100:00100000:3.0:1787381599.614099:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787381599.614107:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+18:15475:x1874205065967232:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787381599.614378:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+18:15475:x1874205065967232:12345-0@lo:502:mount.lustre.0 Request processed in 270us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381599.614386:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787381599.615190:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542860a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:15475:1874205065967232:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787381599.616137:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787381599.616205:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787381599.616273:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787381599.616325:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787381599.616361:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787381599.616409:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787381599.616447:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787381599.616480:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1787381599.616521:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:15475:1874205065967360:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787381599.616589:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381599.616629:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f537000 going to sleep for 11 seconds 00000100:00100000:2.0:1787381599.616889:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065967360 00000100:00100000:2.0:1787381599.616896:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065967360 00000100:00100000:2.0:1787381599.616945:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787381599.616954:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164342c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+18:15475:x1874205065967360:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787381599.617202:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164342c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+18:15475:x1874205065967360:12345-0@lo:502:mount.lustre.0 Request processed in 248us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381599.617211:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787381599.617455:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:15475:1874205065967360:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787381599.617574:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1787381599.617592:0:15475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787381599.619371:0:15480:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787381599.619383:0:15480:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787381599.619386:0:15480:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787381599.619393:0:15480:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a1646075800 00000020:00000080:3.0:1787381599.619395:0:15480:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787381599.619403:0:15480:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787381599.619406:0:15480:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787381599.619407:0:15480:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787381599.619409:0:15480:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787381599.619412:0:15480:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787381599.619413:0:15480:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787381599.619416:0:15480:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a1646075800 00000020:00000080:3.0:1787381599.619418:0:15480:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787381599.619525:0:15480:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787381599.619529:0:15480:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787381599.619530:0:15480:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787381599.619533:0:15480:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787381599.619535:0:15480:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787381599.619536:0:15480:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787381599.619540:0:15480:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a1646075800 00000020:00000080:3.0:1787381599.619542:0:15480:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787381599.622448:0:15480:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787381599.622460:0:15480:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787381599.622462:0:15480:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787381599.622466:0:15480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1787381599.625346:0:15475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787381599.625389:0:15475:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787381599.625526:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a16460c9e00/0xbdc38ada7ea10b13 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10b1a expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381599.625546:0:15475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a16460c9e00/0xbdc38ada7ea10b13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10b1a expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787381599.625593:0:15475:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787381599.625595:0:15475:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a1646075800 10000000:01000000:1.0:1787381599.625598:0:15475:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a1646075800 10000000:01000000:1.0:1787381599.625602:0:15475:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787381599.625607:0:15475:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a1646075800 from 1 10000000:01000000:1.0:1787381599.625610:0:15475:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787381599.625643:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1541389200/0xbdc38ada7ea10b21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381599.625651:0:15475:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a1541389200/0xbdc38ada7ea10b21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381599.625660:0:15475:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a1541389200/0xbdc38ada7ea10b21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381599.625685:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:15475:1874205065967488:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787381599.625750:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381599.625791:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f5370c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787381599.626341:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065967488 00000100:00100000:3.0:1787381599.626349:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065967488 00000100:00100000:3.0:1787381599.627283:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787381599.627307:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164342e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+18:15475:x1874205065967488:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787381599.627323:0:14164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381599.627340:0:14164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1647eb0000/0xbdc38ada7ea10b28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea10b21 expref: -99 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381599.627366:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1647eb0000/0xbdc38ada7ea10b28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea10b21 expref: 19 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381599.627378:0:14164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1647eb0000/0xbdc38ada7ea10b28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea10b21 expref: 19 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381599.627387:0:14164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb0000, rc 0) 00000100:00100000:3.0:1787381599.627450:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164342e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+19:15475:x1874205065967488:12345-0@lo:101:mount.lustre.0 Request processed in 156us (1699us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381599.627457:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787381599.630076:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:15475:1874205065967488:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787381599.630101:0:15475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a1541389200/0xbdc38ada7ea10b21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10b28 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381599.630114:0:15475:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a1541389200/0xbdc38ada7ea10b21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea10b28 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787381599.631476:0:15475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1787381599.631745:0:15475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787381599.632126:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787381599.632174:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787381599.632211:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787381599.632298:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787381599.632341:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787381599.632389:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787381599.632425:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787381599.632461:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787381599.632508:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787381599.632546:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787381599.632581:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787381599.632626:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787381599.632660:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787381599.632695:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787381599.632760:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787381599.632800:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787381599.632853:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787381599.632905:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787381599.632945:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787381599.633000:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787381599.633084:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787381599.633125:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787381599.633176:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787381599.633228:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787381599.633267:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1787381599.640526:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1787381599.640642:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1787381599.640673:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1787381599.640700:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1787381599.640739:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1787381599.640768:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1787381599.640795:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1787381599.640847:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1787381599.640897:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1787381599.641182:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1787381599.641265:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1787381599.641317:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1787381599.641419:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1787381599.641428:0:15475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1787381599.641531:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542860a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:15475:1874205065967616:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787381599.641598:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381599.641643:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1647478240 going to sleep for 11 seconds 00000100:00100000:2.0:1787381599.641758:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065967616 00000100:00100000:2.0:1787381599.641766:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065967616 00000100:00100000:2.0:1787381599.641876:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787381599.641886:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164342f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+19:15475:x1874205065967616:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787381599.642169:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164342f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+19:15475:x1874205065967616:12345-0@lo:501:mount.lustre.0 Request processed in 284us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381599.642176:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787381599.643981:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542860a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:15475:1874205065967616:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787381599.644050:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542860a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:15475:1874205065967744:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787381599.644115:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381599.644145:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1647478240 going to sleep for 11 seconds 00000100:00100000:2.0:1787381599.644949:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065967744 00000100:00100000:2.0:1787381599.644956:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065967744 00000100:00100000:2.0:1787381599.645001:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787381599.645028:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164342c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+19:15475:x1874205065967744:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787381599.645208:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164342c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+19:15475:x1874205065967744:12345-0@lo:503:mount.lustre.0 Request processed in 182us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381599.645216:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787381599.645520:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542860a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:15475:1874205065967744:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787381599.648347:0:15475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787381599.648428:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542860a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:15475:1874205065967872:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787381599.648504:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381599.648554:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065967872 00000100:00100000:0.0:1787381599.648560:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065967872 00000100:00100000:0.0:1787381599.648599:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787381599.648607:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164342d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+19:15475:x1874205065967872:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787381599.648802:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164342d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+19:15475:x1874205065967872:12345-0@lo:502:mount.lustre.0 Request processed in 194us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381599.650903:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787381599.651049:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1647478240 going to sleep for 11 seconds 00000100:00100000:0.0:1787381599.651076:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542860a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:15475:1874205065967872:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787381599.651372:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787381599.651435:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787381599.651469:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787381599.651514:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787381599.651549:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787381599.651611:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787381599.651653:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787381599.651685:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787381599.651729:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787381599.651764:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787381599.655057:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787381599.655192:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787381599.655233:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787381599.655265:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787381599.655325:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787381599.655365:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787381599.655402:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787381599.655455:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787381599.655494:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787381599.655531:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787381599.655580:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787381599.655626:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787381599.655660:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787381599.655707:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787381599.655745:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1787381599.655782:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1787381599.659634:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1787381599.659688:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1787381599.659741:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1787381599.659791:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1787381599.659911:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1787381599.660046:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1787381599.660084:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1787381599.660134:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1787381599.660180:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1787381599.660229:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1787381599.660262:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1787381599.660308:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1787381599.660355:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1787381599.660389:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1787381599.660438:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:15475:1874205065968000:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787381599.660516:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381599.660562:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f537d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787381599.662558:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065968000 00000100:00100000:0.0:1787381599.662572:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065968000 00000100:00100000:0.0:1787381599.662626:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787381599.662636:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164342d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+19:15475:x1874205065968000:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787381599.663121:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:15475:1874205065968000:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787381599.663226:0:15475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1787381599.663240:0:15475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000100:00100000:0.0:1787381599.664474:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164342d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+19:15475:x1874205065968000:12345-0@lo:502:mount.lustre.0 Request processed in 287us (2405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381599.664484:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000020:01000004:2.0:1787381599.669420:0:15485:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787381599.669437:0:15485:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9a167b574d40) 00000020:00000080:2.0:1787381599.669458:0:15485:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1787381599.669638:0:15485:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a1646075800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787381599.669643:0:15485:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a1646075800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787381599.669646:0:15485:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a1646075800 3 00010000:00080000:2.0:1787381599.669676:0:15485:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a154380c000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.122@tcp at head 00010000:00010000:2.0:1787381599.674758:0:15485:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1787381599.677079:0:15485:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787381599.677127:0:15485:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787381599.677148:0:15485:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xbdc38ada7ea10b36 00000100:00080000:2.0:1787381599.677160:0:15485:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787381599.677166:0:15485:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a154380c000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1787381599.677198:0:15485:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a167a6cbb80 x1874205065968128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787381599.677261:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1874205065968128:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787381599.677347:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787381599.677464:0:15485:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000040:00080000:2.0:1787381599.677679:0:15485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1787381599.678098:0:15475:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787381599.678125:0:15475:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787381599.678139:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1541389200/0xbdc38ada7ea10b21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10b28 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381599.678151:0:15475:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a1541389200/0xbdc38ada7ea10b21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10b28 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787381599.678196:0:15475:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787381599.678198:0:15475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787381599.678200:0:15475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787381599.678201:0:15475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787381599.678202:0:15475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787381599.678204:0:15475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787381599.678205:0:15475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787381599.678206:0:15475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787381599.678208:0:15475:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787381599.678211:0:15475:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1787381599.678213:0:15475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787381599.678214:0:15475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787381599.678219:0:15475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787381599.678220:0:15475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787381599.678221:0:15475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787381599.678222:0:15475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787381599.678223:0:15475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787381599.678224:0:15475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787381599.678225:0:15475:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787381599.678243:0:15475:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787381599.678256:0:15475:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:15475:1874205065968256:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787381599.678309:0:15475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381599.678325:0:15475:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f537840 going to sleep for 11 seconds 00000100:00080000:0.0:1787381599.680666:0:2586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787381599.680674:0:2586:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787381599.680677:0:2586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787381599.680681:0:2586:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787381599.680770:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065968256 00000100:00100000:0.0:1787381599.680776:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065968256 00000100:00100000:0.0:1787381599.680832:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787381599.680841:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164342f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+19:15475:x1874205065968256:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787381599.680873:0:14165:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1787381599.680887:0:14165:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787381599.681429:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542860a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874205065968384:0@lo:400:kworker.0 00000100:00100000:1.0:1787381599.681492:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381599.681548:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542863800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1874205065968512:0@lo:400:kworker.0 00000100:00100000:1.0:1787381599.681570:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381599.681605:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065968128 00000100:00100000:1.0:1787381599.681610:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065968128 00000100:00100000:1.0:1787381599.681626:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065968384 00000100:00100000:1.0:1787381599.681629:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065968384 00000100:00100000:1.0:1787381599.681643:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065968512 00000100:00100000:1.0:1787381599.681645:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065968512 00000100:00100000:1.0:1787381599.681669:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787381599.681676:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874205065968384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381599.681721:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874205065968384:12345-0@lo:400:kworker.0 Request processed in 45us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381599.681728:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787381599.681745:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787381599.681752:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874205065968512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381599.681783:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874205065968512:12345-0@lo:400:kworker.0 Request processed in 32us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381599.681800:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787381599.681827:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787381599.681831:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1874205065968128:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787381599.681850:0:14171:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 457 last 0 00000020:00000080:1.0:1787381599.681880:0:14171:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xbdc38ada7ea10b3d 00000004:00100000:1.0:1787381599.681895:0:14171:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787381599.682051:0:14171:0:(import.c:65:import_set_state_nolock()) ffff9a154237e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787381599.686062:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874205065968128:12345-0@lo:38:llog_process_th.0 Request processed in 4221us (8707us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381599.686076:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787381599.686396:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a167a6cbb80 x1874205065968128/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787381609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787381599.686408:0:3307:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787381599.686418:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1787381599.686426:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787381599.686431:0:3307:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787381599.686435:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9a154380c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787381599.686442:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1874205065968128:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1787381599.689941:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787381599.690081:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a1542863800 x1874205065968512/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787381615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381599.690097:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542863800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1874205065968512:0@lo:400:kworker.0 00010000:00080000:1.0:1787381599.690139:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a1542860a80 x1874205065968384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787381615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381599.690149:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542860a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874205065968384:0@lo:400:kworker.0 20000000:01000000:1.0:1787381599.708838:0:14165:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787381599.708857:0:14165:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787381599.709077:0:14187:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787381599.709082:0:14187:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787381599.709103:0:14187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a16460c9a00/0xbdc38ada7ea10b44 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381599.709122:0:14187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a1647eb0c00/0xbdc38ada7ea10ae2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea10adb expref: 19 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381599.709144:0:14187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a16460c9a00/0xbdc38ada7ea10b44 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381599.709181:0:14187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a1647eb0c00/0xbdc38ada7ea10ae2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbdc38ada7ea10adb expref: 19 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381599.709195:0:14187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a1647eb0c00/0xbdc38ada7ea10ae2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbdc38ada7ea10adb expref: 19 pid: 14166 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381599.709210:0:14187:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542860000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14187:1874205065968640:0@lo:104: 00000100:00100000:0.0:1787381599.709275:0:14187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381599.709332:0:14187:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a164feb3900 going to sleep for 11 seconds 00000100:00100000:3.0:1787381599.709399:0:14154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065968640 00000100:00100000:3.0:1787381599.709418:0:14154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065968640 00000100:00100000:3.0:1787381599.709475:0:14154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787381599.709484:0:14154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542861c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+3:14187:x1874205065968640:12345-0@lo:104: 00010000:00010000:3.0:1787381599.709496:0:14154:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9a16460c8e00/0xbdc38ada7ea10adb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea10ae2 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381599.709552:0:14154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787381599.709558:0:14154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542861c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+3:14187:x1874205065968640:12345-0@lo:104: Request processed in 76us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381599.709565:0:14154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787381599.709588:0:14159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787381599.709594:0:14159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a16460c8e00/0xbdc38ada7ea10adb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea10ae2 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381599.709602:0:14159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c8e00 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:3.0:1787381599.709606:0:14159:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a16460c8e00/0xbdc38ada7ea10adb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xbdc38ada7ea10ae2 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381599.709627:0:14159:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a16460c8e00/0xbdc38ada7ea10adb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xbdc38ada7ea10ae2 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787381599.709635:0:14159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a16460c8e00/0xbdc38ada7ea10adb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xbdc38ada7ea10ae2 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787381599.709641:0:14159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787381599.709668:0:14159:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a16460c8e00/0xbdc38ada7ea10adb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea10ae2 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381599.709675:0:14159:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787381599.709691:0:14159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a16460c8e00/0xbdc38ada7ea10adb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea10ae2 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381599.709699:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a16460c8e00/0xbdc38ada7ea10adb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea10ae2 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381599.709714:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381599.709716:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381599.709718:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787381599.710872:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:3311:1874205065968768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787381599.710925:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381599.710989:0:14187:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542860000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14187:1874205065968640:0@lo:104: 00010000:00010000:1.0:1787381599.711036:0:14187:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a16460c9a00/0xbdc38ada7ea10b44 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381599.711116:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065968768 00000100:00100000:3.0:1787381599.711121:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065968768 00010000:00010000:3.0:1787381599.711144:0:14157:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a1647eb0c00/0xbdc38ada7ea10ae2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea10adb expref: 20 pid: 14166 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381599.711173:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787381599.711182:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+20:3311:x1874205065968768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787381599.711207:0:14157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787381599.711213:0:14157:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a1647eb0c00/0xbdc38ada7ea10ae2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea10adb expref: 20 pid: 14166 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381599.711230:0:14157:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a1647eb0c00/0xbdc38ada7ea10ae2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbdc38ada7ea10adb expref: 20 pid: 14166 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381599.711246:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1647eb0c00/0xbdc38ada7ea10ae2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbdc38ada7ea10adb expref: 20 pid: 14166 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381599.711261:0:14157:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a16460c9a00/0xbdc38ada7ea10b44 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381599.711269:0:14157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a16460c9a00/0xbdc38ada7ea10b44 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787381599.711282:0:14157:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008067035s 00010000:00010000:3.0:1787381599.711287:0:14157:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a16460c9a00/0xbdc38ada7ea10b44 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381599.711305:0:14157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a16460c9a00/0xbdc38ada7ea10b44 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381599.711312:0:14157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a16460c9a00/0xbdc38ada7ea10b44 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381599.711319:0:14157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a16460c9a00/0xbdc38ada7ea10b44 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381599.711325:0:14157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c9a00 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:3.0:1787381599.711329:0:14157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a16460c9a00/0xbdc38ada7ea10b44 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381599.711337:0:14157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a16460c9a00/0xbdc38ada7ea10b44 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381599.711357:0:14157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a16460c9a00/0xbdc38ada7ea10b44 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381599.711367:0:14157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787381599.711400:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+19:3311:x1874205065968768:12345-0@lo:103:ldlm_bl.0 Request processed in 220us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381599.711407:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787381599.713262:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:3311:1874205065968768:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787381599.713313:0:14187:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a16460c9a00/0xbdc38ada7ea10b44 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381599.713324:0:14187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a16460c9a00/0xbdc38ada7ea10b44 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381599.713330:0:14187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a16460c9a00/0xbdc38ada7ea10b44 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381599.728484:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164342f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+18:15475:x1874205065968256:12345-0@lo:253:mount.lustre.0 Request processed in 47635us (50164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381599.728500:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787381599.728623:0:15475:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:15475:1874205065968256:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787381599.728637:0:15475:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787381599.728640:0:15475:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787381599.728642:0:15475:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787381599.728644:0:15475:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787381599.728645:0:15475:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787381599.728646:0:15475:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787381599.728648:0:15475:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787381599.728649:0:15475:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787381599.728651:0:15475:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787381599.728652:0:15475:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787381599.728667:0:15475:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787381599.734700:0:15475:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787381599.734873:0:15475:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787381599.735122:0:15475:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787381599.735618:0:15475:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787381599.735774:0:15475:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787381599.735976:0:15475:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787381599.736719:0:15475:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1787381599.799824:0:15475:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787381599.799831:0:15475:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787381599.799861:0:15475:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787381599.799918:0:15475:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.122@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787381599.799932:0:15475:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787381599.799958:0:15475:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1787381600.589910:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787381600.719850:0:3307:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787381585/real 1787381585] req@ffff9a167f59e680 x1874205065961600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787381600 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787381600.719881:0:3307:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a167f59e680 x1874205065961600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787381600 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787381600.719891:0:3307:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787381585/real 1787381585] req@ffff9a167f59e300 x1874205065961728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787381600 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787381600.719901:0:3307:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a167f59e300 x1874205065961728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787381600 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787381600.719920:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9a16659a2000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787381600.719944:0:3307:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787381600.719948:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1874205065961600:0@lo:8:kworker.0 00000100:00080000:3.0:1787381600.719953:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9a167f6ec000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787381600.719974:0:3307:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787381600.719978:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1874205065961728:0@lo:8:kworker.0 00000100:00080000:0.0:1787381600.720071:0:2586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787381600.720075:0:2586:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787381600.720077:0:2586:0:(import.c:65:import_set_state_nolock()) ffff9a16659a2000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787381600.720082:0:2586:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 443 00000100:00080000:0.0:1787381600.720087:0:2586:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787381600.720092:0:2586:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a16659a2000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:0.0:1787381600.720110:0:2586:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a1542863b80 x1874205065969024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787381600.720126:0:2586:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787381600.720128:0:2586:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787381600.720130:0:2586:0:(import.c:65:import_set_state_nolock()) ffff9a167f6ec000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1787381600.720131:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542861180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:3308:1874205065968896:0@lo:400:kworker.0 00000100:00080000:0.0:1787381600.720133:0:2586:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 443 00000100:00080000:0.0:1787381600.720135:0:2586:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787381600.720144:0:2586:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a167f6ec000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:0.0:1787381600.720156:0:2586:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a1542862300 x1874205065969152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787381600.720192:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381600.720225:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065968896 00000100:00100000:0.0:1787381600.720232:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065968896 00000100:00100000:3.0:1787381600.720233:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787381600.720238:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542860700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874205065969280:0@lo:400:kworker.0 00000100:00100000:3.0:1787381600.720260:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381600.720269:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787381600.720277:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a164342cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+18:3308:x1874205065968896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787381600.720296:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065969280 00000100:00100000:3.0:1787381600.720299:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065969280 00000100:00100000:3.0:1787381600.720328:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787381600.720334:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874205065969280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381600.720334:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a164342cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+18:3308:x1874205065968896:12345-0@lo:400:kworker.0 Request processed in 58us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381600.720341:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787381600.720364:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874205065969280:12345-0@lo:400:kworker.0 Request processed in 30us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381600.720370:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787381600.720400:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a1542860700 x1874205065969280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787381616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787381600.720411:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542860700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874205065969280:0@lo:400:kworker.0 00000100:00100000:3.0:1787381600.720420:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542861180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:3308:1874205065968896:0@lo:400:kworker.0 00000100:00100000:3.0:1787381600.720438:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1874205065969024:0@lo:8:kworker.0 00000100:00100000:3.0:1787381600.720473:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381600.720498:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542862300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1874205065969152:0@lo:8:kworker.0 00000100:00100000:3.0:1787381600.720519:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381600.720595:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542860000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1874205065969408:0@lo:400:kworker.0 00000100:00100000:1.0:1787381600.720623:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381600.720642:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787381600.720647:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542860a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1874205065969536:0@lo:400:kworker.0 00000100:00100000:1.0:1787381600.720670:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381600.720695:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065969408 00000100:00100000:1.0:1787381600.720699:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065969408 00000100:00100000:1.0:1787381600.720720:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065969536 00000100:00100000:1.0:1787381600.720723:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065969536 00000100:00100000:1.0:1787381600.720744:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787381600.720749:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874205065969408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381600.720783:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874205065969408:12345-0@lo:400:kworker.0 Request processed in 33us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381600.720789:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787381600.720810:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787381600.720815:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874205065969536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381600.720844:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874205065969536:12345-0@lo:400:kworker.0 Request processed in 29us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381600.720849:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1787381600.720863:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787381600.720879:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a1542860a80 x1874205065969536/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787381616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381600.720888:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542860a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1874205065969536:0@lo:400:kworker.0 00010000:00080000:1.0:1787381600.720898:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a1542860000 x1874205065969408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787381616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787381600.720905:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542860000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1874205065969408:0@lo:400:kworker.0 00000100:00100000:0.0:1787381600.724706:0:14805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065969024 00000100:00100000:0.0:1787381600.724720:0:14805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065969024 00000100:00100000:0.0:1787381600.724764:0:14805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065969152 00000100:00100000:0.0:1787381600.724768:0:14805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065969152 00000100:00100000:0.0:1787381600.724783:0:14805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787381600.724791:0:14805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3307:x1874205065969024:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787381600.724820:0:14805:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 458 last 0 00000020:00000080:0.0:1787381600.724847:0:14805:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbdc38ada7ea10b4b 00002000:00100000:0.0:1787381600.724862:0:14805:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9a1541a2b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113673 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787381600.724866:0:14805:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787381600.724869:0:14805:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787381600.728781:0:14805:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787381600.728817:0:14805:0:(import.c:65:import_set_state_nolock()) ffff9a1541a2c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787381600.728988:0:14805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1874205065969024:12345-0@lo:8:kworker.0 Request processed in 4194us (8511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381600.728999:0:14805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787381600.729055:0:14805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787381600.729068:0:14805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3307:x1874205065969152:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787381600.729092:0:14805:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 458 last 0 00000020:00000080:0.0:1787381600.729116:0:14805:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xbdc38ada7ea10b52 00002000:00100000:0.0:1787381600.729129:0:14805:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9a1541a29800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113673 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787381600.729133:0:14805:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787381600.729136:0:14805:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787381600.729361:0:14805:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787381600.729376:0:14805:0:(import.c:65:import_set_state_nolock()) ffff9a1541a2f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787381600.729408:0:14805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1874205065969152:12345-0@lo:8:kworker.0 Request processed in 340us (8889us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381600.729415:0:14805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787381600.739042:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a1542863b80 x1874205065969024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787381620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787381600.739068:0:3307:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787381600.739078:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787381600.739087:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787381600.739092:0:3307:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787381600.739096:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9a16659a2000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787381600.739117:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787381600.739124:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1874205065969024:0@lo:8:kworker.0 00010000:00080000:3.0:1787381600.739141:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a1542862300 x1874205065969152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787381620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787381600.739148:0:3307:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787381600.739152:0:3307:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787381600.739156:0:3307:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787381600.739159:0:3307:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787381600.739160:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9a167f6ec000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787381600.739171:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787381600.739174:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542862300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1874205065969152:0@lo:8:kworker.0 00000004:00080000:3.0:1787381600.739239:0:14196:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:3.0:1787381600.739260:0:14196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14196:1874205065969792:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787381600.739315:0:14194:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:3.0:1787381600.739327:0:14196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381600.739327:0:14194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14194:1874205065970048:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787381600.739352:0:14196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1658263b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787381600.739357:0:14194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381600.739365:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065969664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787381600.739370:0:14194:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f537d80 going to sleep for 11 seconds 00000004:00080000:1.0:1787381600.739383:0:14193:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1787381600.739388:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381600.739404:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787381600.739408:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065969920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787381600.739434:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381600.739473:0:14808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065969792 00000100:00100000:3.0:1787381600.739480:0:14808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065969792 00000100:00100000:3.0:1787381600.739523:0:14808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065970048 00000100:00100000:3.0:1787381600.739526:0:14808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065970048 00000100:00100000:3.0:1787381600.739544:0:14808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787381600.739553:0:14808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14196:x1874205065969792:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787381600.739811:0:14193:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 458870805575ns, next at 0ns, rc = 0 00000100:00100000:1.0:1787381600.739840:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065969664 00000100:00100000:1.0:1787381600.739844:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065969664 00000100:00100000:1.0:1787381600.739859:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065969920 00000100:00100000:1.0:1787381600.739862:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065969920 00000100:00100000:1.0:1787381600.739873:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787381600.739879:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1874205065969664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787381600.739891:0:14810:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787381600.739931:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1874205065969664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381600.739943:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787381600.739958:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787381600.739964:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1874205065969920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787381600.739981:0:14810:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787381600.740028:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1874205065969920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381600.740034:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00002000:00080000:3.0:1787381600.741864:0:14808:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1787381600.741873:0:14808:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1787381600.741878:0:14808:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00000100:00080000:2.0:1787381600.741950:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787381600.741956:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1787381600.742511:0:14195:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787381600.742810:0:14195:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 458873804477ns, next at 0ns, rc = 0 00010000:00080000:0.0:1787381600.744378:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167a6f7b80 x1874205065969920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381616 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381600.744403:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065969920:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1787381600.744418:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a167f59c380 x1874205065969664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787381616 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381600.744430:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065969664:0@lo:13:osp-pre-1-0.0 00002000:00010000:2.0:1787381600.777832:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787381600.777843:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca8f57b0/0xbdc38ada7ea10b59 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.777870:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1787381600.777874:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787381600.777880:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca8f57b0/0xbdc38ada7ea10b59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.777895:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca8f57b0/0xbdc38ada7ea10b59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.777905:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca8f57b0/0xbdc38ada7ea10b59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.777912:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca8f57b0/0xbdc38ada7ea10b59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.777927:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787381600.778117:0:14159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787381600.778125:0:14159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca8f57b0/0xbdc38ada7ea10b59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.778133:0:14159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a0a00 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:3.0:1787381600.778137:0:14159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca8f57b0/0xbdc38ada7ea10b59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.778146:0:14159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca8f57b0/0xbdc38ada7ea10b59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.778163:0:14159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca8f57b0/0xbdc38ada7ea10b59 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.778170:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca8f57b0/0xbdc38ada7ea10b59 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.778200:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.778202:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.778204:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787381600.778481:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787381600.778488:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be540742/0xbdc38ada7ea10b60 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.778496:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1787381600.778500:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787381600.778504:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be540742/0xbdc38ada7ea10b60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.778513:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be540742/0xbdc38ada7ea10b60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.778671:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be540742/0xbdc38ada7ea10b60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.778678:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be540742/0xbdc38ada7ea10b60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.778700:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787381600.779606:0:14160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787381600.779615:0:14160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be540742/0xbdc38ada7ea10b60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.779626:0:14160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a1800 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:3.0:1787381600.779630:0:14160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be540742/0xbdc38ada7ea10b60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.779640:0:14160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be540742/0xbdc38ada7ea10b60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.779656:0:14160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be540742/0xbdc38ada7ea10b60 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.779663:0:14160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be540742/0xbdc38ada7ea10b60 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.779677:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.779679:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.779681:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787381600.779955:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787381600.779962:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026193fc6/0xbdc38ada7ea10b67 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.779971:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1787381600.779975:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787381600.779980:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026193fc6/0xbdc38ada7ea10b67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.779990:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026193fc6/0xbdc38ada7ea10b67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.779998:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026193fc6/0xbdc38ada7ea10b67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.783441:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026193fc6/0xbdc38ada7ea10b67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.783495:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787381600.784209:0:14159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787381600.784218:0:14159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026193fc6/0xbdc38ada7ea10b67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.784241:0:14159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a1200 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:3.0:1787381600.784246:0:14159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026193fc6/0xbdc38ada7ea10b67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.784257:0:14159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026193fc6/0xbdc38ada7ea10b67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.784277:0:14159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026193fc6/0xbdc38ada7ea10b67 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.784296:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026193fc6/0xbdc38ada7ea10b67 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.784320:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.784322:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.784324:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787381600.785740:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787381600.785750:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077764a1b/0xbdc38ada7ea10b6e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.785764:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1787381600.785768:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787381600.785773:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077764a1b/0xbdc38ada7ea10b6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.785785:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077764a1b/0xbdc38ada7ea10b6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.785794:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077764a1b/0xbdc38ada7ea10b6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.785801:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077764a1b/0xbdc38ada7ea10b6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.785825:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787381600.786224:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787381600.786230:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028ddbdf4/0xbdc38ada7ea10b75 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.786239:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=458s v=(0 0) 00010000:00010000:2.0:1787381600.786248:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787381600.786253:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028ddbdf4/0xbdc38ada7ea10b75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.786264:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028ddbdf4/0xbdc38ada7ea10b75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.786271:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028ddbdf4/0xbdc38ada7ea10b75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.786278:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028ddbdf4/0xbdc38ada7ea10b75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.786758:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787381600.787610:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787381600.787619:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9d6b413/0xbdc38ada7ea10b7c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.787632:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1787381600.787636:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381600.787647:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9d6b413/0xbdc38ada7ea10b7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.787660:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9d6b413/0xbdc38ada7ea10b7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.787669:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9d6b413/0xbdc38ada7ea10b7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.787676:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9d6b413/0xbdc38ada7ea10b7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.787686:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1787381600.788079:0:14160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787381600.788087:0:14160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077764a1b/0xbdc38ada7ea10b6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.788096:0:14160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a1000 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:3.0:1787381600.788102:0:14160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077764a1b/0xbdc38ada7ea10b6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.788112:0:14160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077764a1b/0xbdc38ada7ea10b6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.788135:0:14160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077764a1b/0xbdc38ada7ea10b6e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.788142:0:14160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077764a1b/0xbdc38ada7ea10b6e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.788160:0:14160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787381600.788164:0:14160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028ddbdf4/0xbdc38ada7ea10b75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.788171:0:14160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a0e00 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:3.0:1787381600.788174:0:14160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028ddbdf4/0xbdc38ada7ea10b75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.788181:0:14160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028ddbdf4/0xbdc38ada7ea10b75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.788190:0:14160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028ddbdf4/0xbdc38ada7ea10b75 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.788198:0:14160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028ddbdf4/0xbdc38ada7ea10b75 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.788210:0:14160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787381600.788213:0:14160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9d6b413/0xbdc38ada7ea10b7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.788224:0:14160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c8000 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:3.0:1787381600.788227:0:14160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9d6b413/0xbdc38ada7ea10b7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.788236:0:14160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9d6b413/0xbdc38ada7ea10b7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.788246:0:14160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9d6b413/0xbdc38ada7ea10b7c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.788254:0:14160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9d6b413/0xbdc38ada7ea10b7c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.788267:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.788268:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.788270:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.788308:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787381600.788551:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787381600.788558:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6a046c8/0xbdc38ada7ea10b83 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.788566:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1787381600.788570:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381600.788574:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6a046c8/0xbdc38ada7ea10b83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.788582:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6a046c8/0xbdc38ada7ea10b83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.788590:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6a046c8/0xbdc38ada7ea10b83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.788607:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6a046c8/0xbdc38ada7ea10b83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.788661:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787381600.789161:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787381600.789167:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec1ae6d2/0xbdc38ada7ea10b8a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.789177:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1787381600.789180:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381600.789184:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec1ae6d2/0xbdc38ada7ea10b8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.789194:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec1ae6d2/0xbdc38ada7ea10b8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.789202:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec1ae6d2/0xbdc38ada7ea10b8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.789209:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec1ae6d2/0xbdc38ada7ea10b8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.790814:0:14160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787381600.790827:0:14160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6a046c8/0xbdc38ada7ea10b83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.790841:0:14160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c9c00 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:3.0:1787381600.790845:0:14160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6a046c8/0xbdc38ada7ea10b83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.790870:0:14160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6a046c8/0xbdc38ada7ea10b83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.790888:0:14160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6a046c8/0xbdc38ada7ea10b83 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.790895:0:14160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6a046c8/0xbdc38ada7ea10b83 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.790912:0:14160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787381600.790916:0:14160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec1ae6d2/0xbdc38ada7ea10b8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.790922:0:14160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c8600 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:3.0:1787381600.790925:0:14160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec1ae6d2/0xbdc38ada7ea10b8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.790931:0:14160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec1ae6d2/0xbdc38ada7ea10b8a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.790941:0:14160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec1ae6d2/0xbdc38ada7ea10b8a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.790948:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.790950:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.790957:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381600.792702:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787381600.792715:0:14808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec1ae6d2/0xbdc38ada7ea10b8a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787381600.793349:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787381600.793357:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048065098/0xbdc38ada7ea10b91 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.793371:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1787381600.793375:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381600.793381:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048065098/0xbdc38ada7ea10b91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.793394:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048065098/0xbdc38ada7ea10b91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.793403:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048065098/0xbdc38ada7ea10b91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.793410:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048065098/0xbdc38ada7ea10b91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.793429:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787381600.793884:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787381600.793891:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000186fe811/0xbdc38ada7ea10b98 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.793899:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1787381600.793902:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381600.793911:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000186fe811/0xbdc38ada7ea10b98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.793921:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000186fe811/0xbdc38ada7ea10b98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.793929:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000186fe811/0xbdc38ada7ea10b98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.793936:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000186fe811/0xbdc38ada7ea10b98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.793944:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787381600.794527:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787381600.794534:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078cb7bc2/0xbdc38ada7ea10b9f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.794544:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1787381600.794547:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381600.794551:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078cb7bc2/0xbdc38ada7ea10b9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.794561:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078cb7bc2/0xbdc38ada7ea10b9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.794568:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078cb7bc2/0xbdc38ada7ea10b9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.794586:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078cb7bc2/0xbdc38ada7ea10b9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.794595:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1787381600.795112:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787381600.795120:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000340f6813/0xbdc38ada7ea10ba6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.795129:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1787381600.795132:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381600.795136:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000340f6813/0xbdc38ada7ea10ba6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.795145:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000340f6813/0xbdc38ada7ea10ba6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.795153:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000340f6813/0xbdc38ada7ea10ba6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.795160:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000340f6813/0xbdc38ada7ea10ba6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.795168:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1787381600.795644:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787381600.795651:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006797d52b/0xbdc38ada7ea10bad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.795667:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1787381600.795670:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381600.795674:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006797d52b/0xbdc38ada7ea10bad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.795683:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006797d52b/0xbdc38ada7ea10bad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.795692:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006797d52b/0xbdc38ada7ea10bad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.795699:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006797d52b/0xbdc38ada7ea10bad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.795708:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1787381600.797550:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787381600.797562:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec873412/0xbdc38ada7ea10bb4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.797576:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1787381600.797581:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381600.797586:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec873412/0xbdc38ada7ea10bb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.797598:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec873412/0xbdc38ada7ea10bb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.797619:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec873412/0xbdc38ada7ea10bb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.797626:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec873412/0xbdc38ada7ea10bb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.797636:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1787381600.798175:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787381600.798181:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd8501a6/0xbdc38ada7ea10bbb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.798190:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1787381600.798192:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381600.798196:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd8501a6/0xbdc38ada7ea10bbb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.798205:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd8501a6/0xbdc38ada7ea10bbb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.798212:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd8501a6/0xbdc38ada7ea10bbb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.798218:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd8501a6/0xbdc38ada7ea10bbb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.798239:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:0.0:1787381600.798753:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787381600.798760:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc8074bf/0xbdc38ada7ea10bc2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.798768:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1787381600.798771:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381600.798774:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc8074bf/0xbdc38ada7ea10bc2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.798783:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc8074bf/0xbdc38ada7ea10bc2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.798791:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc8074bf/0xbdc38ada7ea10bc2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.798797:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc8074bf/0xbdc38ada7ea10bc2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.798806:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:3.0:1787381600.799151:0:14159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1787381600.799158:0:14159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048065098/0xbdc38ada7ea10b91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.799166:0:14159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c9000 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:3.0:1787381600.799170:0:14159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048065098/0xbdc38ada7ea10b91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.799179:0:14159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048065098/0xbdc38ada7ea10b91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.799196:0:14159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048065098/0xbdc38ada7ea10b91 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.799203:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048065098/0xbdc38ada7ea10b91 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.799218:0:14159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1787381600.799221:0:14159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000186fe811/0xbdc38ada7ea10b98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.799228:0:14159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c8a00 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:3.0:1787381600.799231:0:14159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000186fe811/0xbdc38ada7ea10b98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.799238:0:14159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000186fe811/0xbdc38ada7ea10b98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.799254:0:14159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000186fe811/0xbdc38ada7ea10b98 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.799262:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000186fe811/0xbdc38ada7ea10b98 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.799273:0:14159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1787381600.799276:0:14159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078cb7bc2/0xbdc38ada7ea10b9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.799294:0:14159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c8400 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:3.0:1787381600.799297:0:14159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078cb7bc2/0xbdc38ada7ea10b9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.799305:0:14159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078cb7bc2/0xbdc38ada7ea10b9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.799314:0:14159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078cb7bc2/0xbdc38ada7ea10b9f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.799320:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078cb7bc2/0xbdc38ada7ea10b9f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.799331:0:14159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787381600.799335:0:14159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000340f6813/0xbdc38ada7ea10ba6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.799345:0:14159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c9a00 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:3.0:1787381600.799349:0:14159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000340f6813/0xbdc38ada7ea10ba6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.799356:0:14159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000340f6813/0xbdc38ada7ea10ba6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.799366:0:14159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000340f6813/0xbdc38ada7ea10ba6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.799373:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000340f6813/0xbdc38ada7ea10ba6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.799384:0:14159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787381600.799387:0:14159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006797d52b/0xbdc38ada7ea10bad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.799393:0:14159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c8e00 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:3.0:1787381600.799396:0:14159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006797d52b/0xbdc38ada7ea10bad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.799403:0:14159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006797d52b/0xbdc38ada7ea10bad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.799411:0:14159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006797d52b/0xbdc38ada7ea10bad lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.799422:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006797d52b/0xbdc38ada7ea10bad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.799434:0:14159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787381600.799437:0:14159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec873412/0xbdc38ada7ea10bb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.799456:0:14159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c9800 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:3.0:1787381600.799459:0:14159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec873412/0xbdc38ada7ea10bb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.799466:0:14159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec873412/0xbdc38ada7ea10bb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.799476:0:14159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec873412/0xbdc38ada7ea10bb4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.799483:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec873412/0xbdc38ada7ea10bb4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.799493:0:14159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787381600.799497:0:14159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd8501a6/0xbdc38ada7ea10bbb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.799503:0:14159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c8800 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:3.0:1787381600.799511:0:14159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd8501a6/0xbdc38ada7ea10bbb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.799517:0:14159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd8501a6/0xbdc38ada7ea10bbb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.799526:0:14159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd8501a6/0xbdc38ada7ea10bbb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.799532:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd8501a6/0xbdc38ada7ea10bbb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.799541:0:14159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787381600.799544:0:14159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc8074bf/0xbdc38ada7ea10bc2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.799549:0:14159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1640031000 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:3.0:1787381600.799552:0:14159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc8074bf/0xbdc38ada7ea10bc2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.799558:0:14159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc8074bf/0xbdc38ada7ea10bc2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.799564:0:14159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc8074bf/0xbdc38ada7ea10bc2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.799570:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc8074bf/0xbdc38ada7ea10bc2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.799585:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.799587:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.799589:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.799680:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787381600.801571:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787381600.801582:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d762bd5/0xbdc38ada7ea10bc9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.801596:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1787381600.801606:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381600.801612:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d762bd5/0xbdc38ada7ea10bc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.801625:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d762bd5/0xbdc38ada7ea10bc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.801632:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d762bd5/0xbdc38ada7ea10bc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.801639:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d762bd5/0xbdc38ada7ea10bc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.801878:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787381600.802384:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787381600.802391:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058c6e390/0xbdc38ada7ea10bd0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.802401:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1787381600.802404:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381600.802408:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058c6e390/0xbdc38ada7ea10bd0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.802417:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058c6e390/0xbdc38ada7ea10bd0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.802426:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058c6e390/0xbdc38ada7ea10bd0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.802439:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058c6e390/0xbdc38ada7ea10bd0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.802923:0:14159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787381600.802931:0:14159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d762bd5/0xbdc38ada7ea10bc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.802939:0:14159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1640031400 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:2.0:1787381600.802943:0:14159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d762bd5/0xbdc38ada7ea10bc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.802953:0:14159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d762bd5/0xbdc38ada7ea10bc9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.803511:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787381600.803617:0:14160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787381600.803842:0:15541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381600.803845:0:15541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381600.803847:0:15541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.803872:0:14160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058c6e390/0xbdc38ada7ea10bd0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.803883:0:14160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1640030c00 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:3.0:1787381600.803887:0:14160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058c6e390/0xbdc38ada7ea10bd0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.803895:0:14160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058c6e390/0xbdc38ada7ea10bd0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.803909:0:14160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058c6e390/0xbdc38ada7ea10bd0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.803916:0:14160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058c6e390/0xbdc38ada7ea10bd0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.803934:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.803935:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.803937:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787381600.804460:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787381600.804468:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007931300f/0xbdc38ada7ea10bd7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.804479:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1787381600.804483:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381600.804489:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007931300f/0xbdc38ada7ea10bd7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.804499:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007931300f/0xbdc38ada7ea10bd7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.804508:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007931300f/0xbdc38ada7ea10bd7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.804515:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007931300f/0xbdc38ada7ea10bd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.804530:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787381600.804869:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787381600.804875:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2cc88c6/0xbdc38ada7ea10bde lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.804888:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1787381600.804890:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381600.804894:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2cc88c6/0xbdc38ada7ea10bde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.804901:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2cc88c6/0xbdc38ada7ea10bde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.804908:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2cc88c6/0xbdc38ada7ea10bde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.804916:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2cc88c6/0xbdc38ada7ea10bde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.804931:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787381600.805315:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787381600.805320:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036a0ff65/0xbdc38ada7ea10be5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.805329:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1787381600.805331:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381600.805335:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036a0ff65/0xbdc38ada7ea10be5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.805343:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036a0ff65/0xbdc38ada7ea10be5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.805361:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036a0ff65/0xbdc38ada7ea10be5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.805367:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036a0ff65/0xbdc38ada7ea10be5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.805373:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1787381600.805718:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787381600.805723:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008cd8e25b/0xbdc38ada7ea10bec lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.805730:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1787381600.805732:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381600.805736:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008cd8e25b/0xbdc38ada7ea10bec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.805743:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008cd8e25b/0xbdc38ada7ea10bec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.805751:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008cd8e25b/0xbdc38ada7ea10bec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.805757:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008cd8e25b/0xbdc38ada7ea10bec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.805774:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1787381600.806211:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787381600.806217:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012722102/0xbdc38ada7ea10bf3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.806226:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1787381600.806229:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381600.806233:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012722102/0xbdc38ada7ea10bf3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.806242:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012722102/0xbdc38ada7ea10bf3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.806249:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012722102/0xbdc38ada7ea10bf3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.806255:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012722102/0xbdc38ada7ea10bf3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.806263:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1787381600.806653:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787381600.806659:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011f3184d/0xbdc38ada7ea10bfa lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.806666:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1787381600.806674:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381600.806678:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011f3184d/0xbdc38ada7ea10bfa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.806686:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011f3184d/0xbdc38ada7ea10bfa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.806693:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011f3184d/0xbdc38ada7ea10bfa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.806699:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011f3184d/0xbdc38ada7ea10bfa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.806706:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1787381600.807119:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787381600.807125:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040802f1c/0xbdc38ada7ea10c01 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.807133:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1787381600.807135:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381600.807139:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040802f1c/0xbdc38ada7ea10c01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.807149:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040802f1c/0xbdc38ada7ea10c01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.807157:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040802f1c/0xbdc38ada7ea10c01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.807169:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040802f1c/0xbdc38ada7ea10c01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.807178:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:1.0:1787381600.807355:0:15541:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1787381600.807362:0:15541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007931300f/0xbdc38ada7ea10bd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.807370:0:15541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1640030800 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:1.0:1787381600.807376:0:15541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007931300f/0xbdc38ada7ea10bd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.807385:0:15541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007931300f/0xbdc38ada7ea10bd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.807405:0:15541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007931300f/0xbdc38ada7ea10bd7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.807412:0:15541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007931300f/0xbdc38ada7ea10bd7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.807444:0:15541:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1787381600.807448:0:15541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2cc88c6/0xbdc38ada7ea10bde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.807454:0:15541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1640031600 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:1.0:1787381600.807457:0:15541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2cc88c6/0xbdc38ada7ea10bde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.807464:0:15541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2cc88c6/0xbdc38ada7ea10bde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.807475:0:15541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2cc88c6/0xbdc38ada7ea10bde lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.807483:0:15541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2cc88c6/0xbdc38ada7ea10bde lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.807496:0:15541:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787381600.807500:0:15541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036a0ff65/0xbdc38ada7ea10be5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.807506:0:15541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1640030a00 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:1.0:1787381600.807510:0:15541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036a0ff65/0xbdc38ada7ea10be5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.807528:0:15541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036a0ff65/0xbdc38ada7ea10be5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.807539:0:15541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036a0ff65/0xbdc38ada7ea10be5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.807547:0:15541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036a0ff65/0xbdc38ada7ea10be5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.807560:0:15541:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787381600.807563:0:15541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008cd8e25b/0xbdc38ada7ea10bec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.807570:0:15541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1640031e00 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:1.0:1787381600.807574:0:15541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008cd8e25b/0xbdc38ada7ea10bec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.807581:0:15541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008cd8e25b/0xbdc38ada7ea10bec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.807591:0:15541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008cd8e25b/0xbdc38ada7ea10bec lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.807598:0:15541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008cd8e25b/0xbdc38ada7ea10bec lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.807621:0:15541:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787381600.807625:0:15541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012722102/0xbdc38ada7ea10bf3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.807631:0:15541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1640030600 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:1.0:1787381600.807635:0:15541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012722102/0xbdc38ada7ea10bf3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.807641:0:15541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012722102/0xbdc38ada7ea10bf3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.807651:0:15541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012722102/0xbdc38ada7ea10bf3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.807658:0:15541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012722102/0xbdc38ada7ea10bf3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.807669:0:15541:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787381600.807673:0:15541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011f3184d/0xbdc38ada7ea10bfa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.807679:0:15541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1640030000 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:1.0:1787381600.807682:0:15541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011f3184d/0xbdc38ada7ea10bfa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.807700:0:15541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011f3184d/0xbdc38ada7ea10bfa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.807710:0:15541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011f3184d/0xbdc38ada7ea10bfa lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.807717:0:15541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011f3184d/0xbdc38ada7ea10bfa lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.807727:0:15541:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787381600.807730:0:15541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040802f1c/0xbdc38ada7ea10c01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.807736:0:15541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1645bc9400 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:1.0:1787381600.807739:0:15541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040802f1c/0xbdc38ada7ea10c01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.807746:0:15541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040802f1c/0xbdc38ada7ea10c01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.807754:0:15541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040802f1c/0xbdc38ada7ea10c01 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.807760:0:15541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040802f1c/0xbdc38ada7ea10c01 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.807779:0:15541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381600.807781:0:15541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381600.807783:0:15541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.808131:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381600.814724:0:14159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d762bd5/0xbdc38ada7ea10bc9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.814756:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d762bd5/0xbdc38ada7ea10bc9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.815088:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.815097:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.815099:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787381600.820865:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787381600.820878:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb3bd7ee/0xbdc38ada7ea10c08 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.820894:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=458s v=(0 0) 00010000:00010000:1.0:1787381600.820899:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787381600.820906:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb3bd7ee/0xbdc38ada7ea10c08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.820919:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb3bd7ee/0xbdc38ada7ea10c08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.820929:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb3bd7ee/0xbdc38ada7ea10c08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.820938:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb3bd7ee/0xbdc38ada7ea10c08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.822494:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787381600.823742:0:15541:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787381600.823753:0:15541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb3bd7ee/0xbdc38ada7ea10c08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.823780:0:15541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388800 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:1.0:1787381600.823785:0:15541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb3bd7ee/0xbdc38ada7ea10c08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.823797:0:15541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb3bd7ee/0xbdc38ada7ea10c08 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.823818:0:15541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb3bd7ee/0xbdc38ada7ea10c08 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.823825:0:15541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb3bd7ee/0xbdc38ada7ea10c08 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.823843:0:15541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381600.823845:0:15541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381600.823846:0:15541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787381600.824488:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787381600.824496:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9b9c205/0xbdc38ada7ea10c0f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.824507:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1787381600.824511:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381600.824516:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9b9c205/0xbdc38ada7ea10c0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.824527:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9b9c205/0xbdc38ada7ea10c0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.824537:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9b9c205/0xbdc38ada7ea10c0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.824544:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9b9c205/0xbdc38ada7ea10c0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.824561:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787381600.824664:0:14160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787381600.824670:0:14160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9b9c205/0xbdc38ada7ea10c0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.824678:0:14160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1645bc9800 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:3.0:1787381600.824682:0:14160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9b9c205/0xbdc38ada7ea10c0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.824690:0:14160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9b9c205/0xbdc38ada7ea10c0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.824702:0:14160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9b9c205/0xbdc38ada7ea10c0f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.824709:0:14160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9b9c205/0xbdc38ada7ea10c0f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.824722:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.824723:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.824725:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787381600.825330:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787381600.825336:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006eba2fd2/0xbdc38ada7ea10c16 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.825349:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1787381600.825352:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381600.825356:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006eba2fd2/0xbdc38ada7ea10c16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.825365:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006eba2fd2/0xbdc38ada7ea10c16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.825372:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006eba2fd2/0xbdc38ada7ea10c16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.825379:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006eba2fd2/0xbdc38ada7ea10c16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.825433:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1787381600.825692:0:14808:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:0.0:1787381600.825788:0:14808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14196:x1874205065969792:12345-0@lo:5:osp-pre-1-0.0 Request processed in 86233us (86457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381600.825799:0:14808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787381600.825832:0:14808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787381600.825844:0:14808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14194:x1874205065970048:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1787381600.827461:0:14196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14196:1874205065969792:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787381600.827478:0:14196:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:1.0:1787381600.827543:0:14196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14196:1874205065970176:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787381600.827599:0:14196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381600.827644:0:14196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f5b3900 going to sleep for 11 seconds 00000100:00100000:1.0:1787381600.828077:0:14807:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787381600.828087:0:14807:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00010000:3.0:1787381600.830304:0:14159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787381600.830317:0:14159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006eba2fd2/0xbdc38ada7ea10c16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.830332:0:14159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1645bc8600 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:3.0:1787381600.830337:0:14159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006eba2fd2/0xbdc38ada7ea10c16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.830356:0:14159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006eba2fd2/0xbdc38ada7ea10c16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.830378:0:14159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006eba2fd2/0xbdc38ada7ea10c16 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.830387:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006eba2fd2/0xbdc38ada7ea10c16 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.832926:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.832931:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.832934:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787381600.835321:0:14808:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1787381600.835333:0:14808:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1787381600.835339:0:14808:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00000004:00080000:3.0:1787381600.836756:0:5813:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1787381600.836776:0:5813:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1787381600.842238:0:14807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065970176 00000100:00100000:1.0:1787381600.842252:0:14807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065970176 00000100:00100000:3.0:1787381600.843585:0:15543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787381600.843602:0:15543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14196:x1874205065970176:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1787381600.843654:0:15543:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00002000:00010000:0.0:1787381600.847750:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787381600.847768:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000393250d3/0xbdc38ada7ea10c1d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.847785:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1787381600.847790:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381600.847796:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000393250d3/0xbdc38ada7ea10c1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.847814:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000393250d3/0xbdc38ada7ea10c1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.847824:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000393250d3/0xbdc38ada7ea10c1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.847830:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000393250d3/0xbdc38ada7ea10c1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.847859:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787381600.848361:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787381600.848367:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119237d3/0xbdc38ada7ea10c24 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.848376:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1787381600.848379:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381600.848383:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000119237d3/0xbdc38ada7ea10c24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.848392:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000119237d3/0xbdc38ada7ea10c24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.848407:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000119237d3/0xbdc38ada7ea10c24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.848414:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000119237d3/0xbdc38ada7ea10c24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.848428:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787381600.850053:0:14160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787381600.850062:0:14160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000393250d3/0xbdc38ada7ea10c1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.850073:0:14160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1645bc8c00 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:2.0:1787381600.850078:0:14160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000393250d3/0xbdc38ada7ea10c1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.850090:0:14160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000393250d3/0xbdc38ada7ea10c1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.850110:0:14160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000393250d3/0xbdc38ada7ea10c1d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.850117:0:14160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000393250d3/0xbdc38ada7ea10c1d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.850137:0:14160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787381600.850140:0:14160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000119237d3/0xbdc38ada7ea10c24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.850146:0:14160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1645bc9600 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:2.0:1787381600.850155:0:14160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000119237d3/0xbdc38ada7ea10c24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.850161:0:14160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000119237d3/0xbdc38ada7ea10c24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.850170:0:14160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000119237d3/0xbdc38ada7ea10c24 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.850177:0:14160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000119237d3/0xbdc38ada7ea10c24 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.850187:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381600.850188:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381600.850190:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787381600.851096:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787381600.851104:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000285e1835/0xbdc38ada7ea10c2b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.851117:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1787381600.851121:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381600.851127:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000285e1835/0xbdc38ada7ea10c2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.851140:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000285e1835/0xbdc38ada7ea10c2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.851149:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000285e1835/0xbdc38ada7ea10c2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.851158:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000285e1835/0xbdc38ada7ea10c2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.851194:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787381600.851332:0:14159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787381600.851338:0:14159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000285e1835/0xbdc38ada7ea10c2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.851345:0:14159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1645bc9000 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:2.0:1787381600.851349:0:14159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000285e1835/0xbdc38ada7ea10c2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.851357:0:14159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000285e1835/0xbdc38ada7ea10c2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.851369:0:14159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000285e1835/0xbdc38ada7ea10c2b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.851381:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000285e1835/0xbdc38ada7ea10c2b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.851396:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381600.851398:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381600.851399:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787381600.852834:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787381600.852844:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000eea82fc/0xbdc38ada7ea10c32 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.852856:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1787381600.852860:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381600.852865:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000eea82fc/0xbdc38ada7ea10c32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.852876:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000eea82fc/0xbdc38ada7ea10c32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.852885:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000eea82fc/0xbdc38ada7ea10c32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.852892:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000eea82fc/0xbdc38ada7ea10c32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.853042:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787381600.853502:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787381600.853509:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000461d2abe/0xbdc38ada7ea10c39 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.853518:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1787381600.853527:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381600.853532:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000461d2abe/0xbdc38ada7ea10c39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.853541:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000461d2abe/0xbdc38ada7ea10c39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.853549:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000461d2abe/0xbdc38ada7ea10c39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.853557:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000461d2abe/0xbdc38ada7ea10c39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381600.854499:0:15543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:14196:x1874205065970176:12345-0@lo:5:osp-pre-1-0.0 Request processed in 10897us (26894us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787381600.854510:0:15543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1787381600.854937:0:14160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787381600.854947:0:14160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000eea82fc/0xbdc38ada7ea10c32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.855088:0:14160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1645bc8a00 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:2.0:1787381600.855094:0:14160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000eea82fc/0xbdc38ada7ea10c32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.855104:0:14160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000eea82fc/0xbdc38ada7ea10c32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.855123:0:14160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000eea82fc/0xbdc38ada7ea10c32 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.855130:0:14160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000eea82fc/0xbdc38ada7ea10c32 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.855208:0:14160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787381600.855212:0:14160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000461d2abe/0xbdc38ada7ea10c39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.855219:0:14160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1645bc8800 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:3.0:1787381600.855233:0:14160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000461d2abe/0xbdc38ada7ea10c39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.855241:0:14160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000461d2abe/0xbdc38ada7ea10c39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.855256:0:14160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000461d2abe/0xbdc38ada7ea10c39 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.855264:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.855266:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.855268:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381600.855353:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787381600.855361:0:14808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000461d2abe/0xbdc38ada7ea10c39 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381600.855658:0:14196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14196:1874205065970176:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787381600.855673:0:14196:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00002000:00010000:0.0:1787381600.856384:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787381600.856392:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e8e08cc/0xbdc38ada7ea10c40 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.856405:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1787381600.856409:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381600.856415:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e8e08cc/0xbdc38ada7ea10c40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.856426:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e8e08cc/0xbdc38ada7ea10c40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.856550:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e8e08cc/0xbdc38ada7ea10c40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.856559:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e8e08cc/0xbdc38ada7ea10c40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.856785:0:14159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787381600.856792:0:14159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e8e08cc/0xbdc38ada7ea10c40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.856806:0:14159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1645bc9200 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:2.0:1787381600.856810:0:14159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e8e08cc/0xbdc38ada7ea10c40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.856820:0:14159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e8e08cc/0xbdc38ada7ea10c40 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.856835:0:14159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e8e08cc/0xbdc38ada7ea10c40 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.856843:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381600.856845:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381600.856847:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381600.866052:0:15541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381600.866213:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787381600.866225:0:14808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e8e08cc/0xbdc38ada7ea10c40 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787381600.867293:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787381600.867302:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ba7142f/0xbdc38ada7ea10c47 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.867315:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1787381600.867320:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381600.867326:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ba7142f/0xbdc38ada7ea10c47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.867339:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ba7142f/0xbdc38ada7ea10c47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.867349:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ba7142f/0xbdc38ada7ea10c47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.867369:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ba7142f/0xbdc38ada7ea10c47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.867678:0:14160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787381600.867685:0:14160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ba7142f/0xbdc38ada7ea10c47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.867694:0:14160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1645bc8e00 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:3.0:1787381600.867698:0:14160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ba7142f/0xbdc38ada7ea10c47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.867708:0:14160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ba7142f/0xbdc38ada7ea10c47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.867724:0:14160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ba7142f/0xbdc38ada7ea10c47 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.867731:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.867740:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.867742:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381600.868314:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787381600.868321:0:14808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ba7142f/0xbdc38ada7ea10c47 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.868573:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787381600.869155:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787381600.869162:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000568674cd/0xbdc38ada7ea10c4e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.869174:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=458s v=(0 0) 00010000:00010000:0.0:1787381600.869179:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381600.869184:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000568674cd/0xbdc38ada7ea10c4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.869196:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000568674cd/0xbdc38ada7ea10c4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.869204:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000568674cd/0xbdc38ada7ea10c4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.869211:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000568674cd/0xbdc38ada7ea10c4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.869239:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787381600.869357:0:15541:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787381600.869364:0:15541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000568674cd/0xbdc38ada7ea10c4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.869372:0:15541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1645bc8400 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:1.0:1787381600.869376:0:15541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000568674cd/0xbdc38ada7ea10c4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.869385:0:15541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000568674cd/0xbdc38ada7ea10c4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.869403:0:15541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000568674cd/0xbdc38ada7ea10c4e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.869410:0:15541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000568674cd/0xbdc38ada7ea10c4e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.869426:0:15541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381600.869428:0:15541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381600.869430:0:15541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787381600.870291:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787381600.870300:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb08537c/0xbdc38ada7ea10c55 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.870310:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1787381600.870314:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381600.870319:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb08537c/0xbdc38ada7ea10c55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.870331:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb08537c/0xbdc38ada7ea10c55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.870341:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb08537c/0xbdc38ada7ea10c55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.870348:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb08537c/0xbdc38ada7ea10c55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.870370:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787381600.871416:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787381600.871424:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab2ea2d6/0xbdc38ada7ea10c5c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.871436:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1787381600.875551:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381600.875680:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab2ea2d6/0xbdc38ada7ea10c5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.875704:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab2ea2d6/0xbdc38ada7ea10c5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.875716:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab2ea2d6/0xbdc38ada7ea10c5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.875725:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab2ea2d6/0xbdc38ada7ea10c5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.875752:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787381600.876389:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787381600.876397:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a86dfc0a/0xbdc38ada7ea10c63 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.876408:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1787381600.876411:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381600.876416:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a86dfc0a/0xbdc38ada7ea10c63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.876425:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a86dfc0a/0xbdc38ada7ea10c63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.876434:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a86dfc0a/0xbdc38ada7ea10c63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.876769:0:14159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787381600.876778:0:14159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb08537c/0xbdc38ada7ea10c55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.876787:0:14159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1645bc9a00 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:3.0:1787381600.876792:0:14159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb08537c/0xbdc38ada7ea10c55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.876801:0:14159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb08537c/0xbdc38ada7ea10c55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.876819:0:14159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb08537c/0xbdc38ada7ea10c55 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.876826:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb08537c/0xbdc38ada7ea10c55 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.876849:0:14159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787381600.876853:0:14159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab2ea2d6/0xbdc38ada7ea10c5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.876859:0:14159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1645bc8200 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:3.0:1787381600.876862:0:14159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab2ea2d6/0xbdc38ada7ea10c5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.876880:0:14159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab2ea2d6/0xbdc38ada7ea10c5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.876891:0:14159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab2ea2d6/0xbdc38ada7ea10c5c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.876898:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab2ea2d6/0xbdc38ada7ea10c5c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.876911:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.876912:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.876914:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381600.877113:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a86dfc0a/0xbdc38ada7ea10c63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.877149:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787381600.877578:0:15541:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787381600.877584:0:15541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a86dfc0a/0xbdc38ada7ea10c63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.877593:0:15541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1645bc9c00 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:3.0:1787381600.877596:0:15541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a86dfc0a/0xbdc38ada7ea10c63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.877605:0:15541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a86dfc0a/0xbdc38ada7ea10c63 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.877616:0:15541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a86dfc0a/0xbdc38ada7ea10c63 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.877634:0:15541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a86dfc0a/0xbdc38ada7ea10c63 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.877649:0:15541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.877651:0:15541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.877653:0:15541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381600.877676:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787381600.877902:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787381600.877908:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e75451e7/0xbdc38ada7ea10c6a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.877916:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1787381600.877920:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381600.877924:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e75451e7/0xbdc38ada7ea10c6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.877934:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e75451e7/0xbdc38ada7ea10c6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.877941:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e75451e7/0xbdc38ada7ea10c6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.877947:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e75451e7/0xbdc38ada7ea10c6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.878123:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787381600.879130:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787381600.879137:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e8e08cc/0xbdc38ada7ea10c71 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.879154:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1787381600.879158:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381600.879163:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e8e08cc/0xbdc38ada7ea10c71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.879173:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e8e08cc/0xbdc38ada7ea10c71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.879182:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e8e08cc/0xbdc38ada7ea10c71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.879189:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e8e08cc/0xbdc38ada7ea10c71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.883139:0:14159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787381600.883152:0:14159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e75451e7/0xbdc38ada7ea10c6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.883166:0:14159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1645bc8000 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:3.0:1787381600.883171:0:14159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e75451e7/0xbdc38ada7ea10c6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.883182:0:14159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e75451e7/0xbdc38ada7ea10c6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.883202:0:14159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e75451e7/0xbdc38ada7ea10c6a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.883210:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e75451e7/0xbdc38ada7ea10c6a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.884923:0:14159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787381600.884934:0:14159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e8e08cc/0xbdc38ada7ea10c71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.884964:0:14159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1645bc9200 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:3.0:1787381600.884969:0:14159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e8e08cc/0xbdc38ada7ea10c71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.884979:0:14159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e8e08cc/0xbdc38ada7ea10c71 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.884998:0:14159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e8e08cc/0xbdc38ada7ea10c71 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.885024:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.885025:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.885028:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381600.885244:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787381600.885252:0:14808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e8e08cc/0xbdc38ada7ea10c71 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787381600.886120:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787381600.886129:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000461d2abe/0xbdc38ada7ea10c78 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.886142:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1787381600.886147:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381600.886153:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000461d2abe/0xbdc38ada7ea10c78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.886176:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000461d2abe/0xbdc38ada7ea10c78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.886185:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000461d2abe/0xbdc38ada7ea10c78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.886193:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000461d2abe/0xbdc38ada7ea10c78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.886218:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787381600.886839:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787381600.886846:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c23f0d40/0xbdc38ada7ea10c7f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.886855:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1787381600.886859:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381600.886862:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c23f0d40/0xbdc38ada7ea10c7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.886871:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c23f0d40/0xbdc38ada7ea10c7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.886879:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c23f0d40/0xbdc38ada7ea10c7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.886898:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c23f0d40/0xbdc38ada7ea10c7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.886911:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787381600.887622:0:14159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787381600.887631:0:14159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000461d2abe/0xbdc38ada7ea10c78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.887640:0:14159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1645bc8800 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:3.0:1787381600.887645:0:14159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000461d2abe/0xbdc38ada7ea10c78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.887655:0:14159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000461d2abe/0xbdc38ada7ea10c78 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.887671:0:14159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000461d2abe/0xbdc38ada7ea10c78 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.887688:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000461d2abe/0xbdc38ada7ea10c78 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.887707:0:14159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787381600.887711:0:14159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c23f0d40/0xbdc38ada7ea10c7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.887717:0:14159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1645bc9e00 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:3.0:1787381600.887720:0:14159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c23f0d40/0xbdc38ada7ea10c7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.887729:0:14159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c23f0d40/0xbdc38ada7ea10c7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.887739:0:14159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c23f0d40/0xbdc38ada7ea10c7f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.887747:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c23f0d40/0xbdc38ada7ea10c7f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.887757:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.887759:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.887761:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.887768:0:15541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787381600.887937:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787381600.887943:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006eba2fd2/0xbdc38ada7ea10c86 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.887963:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1787381600.887966:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381600.887971:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006eba2fd2/0xbdc38ada7ea10c86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.887981:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006eba2fd2/0xbdc38ada7ea10c86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.887990:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006eba2fd2/0xbdc38ada7ea10c86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.887997:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006eba2fd2/0xbdc38ada7ea10c86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.888051:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381600.888065:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787381600.888637:0:14159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787381600.888643:0:14159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006eba2fd2/0xbdc38ada7ea10c86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.888659:0:14159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1645bc8600 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:3.0:1787381600.888663:0:14159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006eba2fd2/0xbdc38ada7ea10c86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.888672:0:14159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006eba2fd2/0xbdc38ada7ea10c86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.888684:0:14159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006eba2fd2/0xbdc38ada7ea10c86 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.888691:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006eba2fd2/0xbdc38ada7ea10c86 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.888707:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.888709:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.888710:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787381600.888885:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787381600.888898:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000eea82fc/0xbdc38ada7ea10c8d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.888906:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1787381600.888910:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381600.888914:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000eea82fc/0xbdc38ada7ea10c8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.888923:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000eea82fc/0xbdc38ada7ea10c8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.888931:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000eea82fc/0xbdc38ada7ea10c8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.888938:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000eea82fc/0xbdc38ada7ea10c8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.890145:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787381600.890177:0:15541:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787381600.890182:0:15541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000eea82fc/0xbdc38ada7ea10c8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.890201:0:15541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1645bc8a00 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:0.0:1787381600.890205:0:15541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000eea82fc/0xbdc38ada7ea10c8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.890213:0:15541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000eea82fc/0xbdc38ada7ea10c8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.890237:0:15541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000eea82fc/0xbdc38ada7ea10c8d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.890243:0:15541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000eea82fc/0xbdc38ada7ea10c8d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.890262:0:15541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381600.890264:0:15541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381600.890266:0:15541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787381600.890861:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787381600.890869:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb3bd7ee/0xbdc38ada7ea10c94 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.890890:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1787381600.890893:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787381600.890898:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb3bd7ee/0xbdc38ada7ea10c94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.890908:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb3bd7ee/0xbdc38ada7ea10c94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.890918:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb3bd7ee/0xbdc38ada7ea10c94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.890925:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb3bd7ee/0xbdc38ada7ea10c94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.890947:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787381600.891208:0:14160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787381600.891214:0:14160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb3bd7ee/0xbdc38ada7ea10c94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.891222:0:14160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388800 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:0.0:1787381600.891226:0:14160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb3bd7ee/0xbdc38ada7ea10c94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.891234:0:14160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb3bd7ee/0xbdc38ada7ea10c94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.891248:0:14160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb3bd7ee/0xbdc38ada7ea10c94 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.891254:0:14160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb3bd7ee/0xbdc38ada7ea10c94 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.891278:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381600.891280:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381600.891291:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787381600.895876:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787381600.895892:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f20f47b/0xbdc38ada7ea10c9b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.895911:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1787381600.895915:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787381600.895922:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f20f47b/0xbdc38ada7ea10c9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.895934:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f20f47b/0xbdc38ada7ea10c9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.895955:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f20f47b/0xbdc38ada7ea10c9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.895963:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f20f47b/0xbdc38ada7ea10c9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.895992:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787381600.896082:0:14159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787381600.896090:0:14159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f20f47b/0xbdc38ada7ea10c9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.896100:0:14159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541389e00 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:3.0:1787381600.896105:0:14159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f20f47b/0xbdc38ada7ea10c9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.896116:0:14159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f20f47b/0xbdc38ada7ea10c9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.896153:0:14159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f20f47b/0xbdc38ada7ea10c9b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.896162:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f20f47b/0xbdc38ada7ea10c9b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.896182:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.896184:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.896187:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787381600.898069:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787381600.898079:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f8d9553/0xbdc38ada7ea10ca2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.898093:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1787381600.898097:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787381600.898102:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f8d9553/0xbdc38ada7ea10ca2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.898114:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f8d9553/0xbdc38ada7ea10ca2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.898123:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f8d9553/0xbdc38ada7ea10ca2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.898130:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f8d9553/0xbdc38ada7ea10ca2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.898167:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787381600.899366:0:15541:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787381600.899378:0:15541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f8d9553/0xbdc38ada7ea10ca2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.899389:0:15541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388200 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:3.0:1787381600.899394:0:15541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f8d9553/0xbdc38ada7ea10ca2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.899405:0:15541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f8d9553/0xbdc38ada7ea10ca2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.899425:0:15541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f8d9553/0xbdc38ada7ea10ca2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.899433:0:15541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f8d9553/0xbdc38ada7ea10ca2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.899467:0:15541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.899469:0:15541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.899471:0:15541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787381600.899942:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787381600.899949:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000343f927c/0xbdc38ada7ea10ca9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.899959:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1787381600.899962:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787381600.899967:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000343f927c/0xbdc38ada7ea10ca9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.899976:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000343f927c/0xbdc38ada7ea10ca9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.899984:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000343f927c/0xbdc38ada7ea10ca9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.899991:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000343f927c/0xbdc38ada7ea10ca9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.900025:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787381600.900390:0:14160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787381600.900397:0:14160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000343f927c/0xbdc38ada7ea10ca9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.900404:0:14160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388600 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:2.0:1787381600.900408:0:14160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000343f927c/0xbdc38ada7ea10ca9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.900417:0:14160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000343f927c/0xbdc38ada7ea10ca9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.900429:0:14160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000343f927c/0xbdc38ada7ea10ca9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.900443:0:14160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000343f927c/0xbdc38ada7ea10ca9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.900458:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381600.900460:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381600.900462:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787381600.902434:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787381600.904370:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ee6f15d/0xbdc38ada7ea10cb0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.904388:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1787381600.904400:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787381600.904406:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ee6f15d/0xbdc38ada7ea10cb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.904421:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ee6f15d/0xbdc38ada7ea10cb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.904431:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ee6f15d/0xbdc38ada7ea10cb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.904500:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ee6f15d/0xbdc38ada7ea10cb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.904533:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787381600.905839:0:14159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787381600.905849:0:14159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ee6f15d/0xbdc38ada7ea10cb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.905860:0:14159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388c00 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:0.0:1787381600.905865:0:14159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ee6f15d/0xbdc38ada7ea10cb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.905876:0:14159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ee6f15d/0xbdc38ada7ea10cb0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.905895:0:14159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ee6f15d/0xbdc38ada7ea10cb0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.905903:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ee6f15d/0xbdc38ada7ea10cb0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.905923:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381600.905925:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381600.905927:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787381600.906265:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787381600.906274:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003aaf3309/0xbdc38ada7ea10cb7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.906293:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1787381600.906298:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787381600.906303:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003aaf3309/0xbdc38ada7ea10cb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.906315:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003aaf3309/0xbdc38ada7ea10cb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.906324:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003aaf3309/0xbdc38ada7ea10cb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.906339:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003aaf3309/0xbdc38ada7ea10cb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.906392:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787381600.906916:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787381600.906923:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043efedcc/0xbdc38ada7ea10cbe lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.906931:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1787381600.906934:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787381600.906938:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000043efedcc/0xbdc38ada7ea10cbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.906946:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000043efedcc/0xbdc38ada7ea10cbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.906954:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000043efedcc/0xbdc38ada7ea10cbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.906961:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000043efedcc/0xbdc38ada7ea10cbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.908091:0:15541:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787381600.908102:0:15541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003aaf3309/0xbdc38ada7ea10cb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.908126:0:15541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388400 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:0.0:1787381600.908131:0:15541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003aaf3309/0xbdc38ada7ea10cb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.908142:0:15541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003aaf3309/0xbdc38ada7ea10cb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.908160:0:15541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003aaf3309/0xbdc38ada7ea10cb7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.908167:0:15541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003aaf3309/0xbdc38ada7ea10cb7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.908199:0:15541:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787381600.908204:0:15541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000043efedcc/0xbdc38ada7ea10cbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.908211:0:15541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541389600 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:0.0:1787381600.908214:0:15541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000043efedcc/0xbdc38ada7ea10cbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.908221:0:15541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000043efedcc/0xbdc38ada7ea10cbe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.908231:0:15541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000043efedcc/0xbdc38ada7ea10cbe lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381600.908246:0:15541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381600.908248:0:15541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381600.908250:0:15541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381600.908654:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787381600.908661:0:14808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000043efedcc/0xbdc38ada7ea10cbe lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787381600.909421:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787381600.909428:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5efcfb7/0xbdc38ada7ea10cc5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.909439:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1787381600.909594:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787381600.909601:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5efcfb7/0xbdc38ada7ea10cc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.909614:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5efcfb7/0xbdc38ada7ea10cc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.909624:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5efcfb7/0xbdc38ada7ea10cc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.909632:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5efcfb7/0xbdc38ada7ea10cc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.909702:0:14160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787381600.909719:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00002000:00010000:1.0:1787381600.910171:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787381600.910177:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c59fcf99/0xbdc38ada7ea10ccc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.910185:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1787381600.910202:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787381600.910212:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c59fcf99/0xbdc38ada7ea10ccc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.910221:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c59fcf99/0xbdc38ada7ea10ccc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.910229:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c59fcf99/0xbdc38ada7ea10ccc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.910235:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c59fcf99/0xbdc38ada7ea10ccc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.910671:0:14159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787381600.910680:0:14159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c59fcf99/0xbdc38ada7ea10ccc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.910688:0:14159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388000 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:3.0:1787381600.910693:0:14159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c59fcf99/0xbdc38ada7ea10ccc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.910702:0:14159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c59fcf99/0xbdc38ada7ea10ccc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.910718:0:14159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c59fcf99/0xbdc38ada7ea10ccc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.910728:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.910729:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.910732:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381600.910783:0:14160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5efcfb7/0xbdc38ada7ea10cc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.910792:0:14160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541389c00 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:2.0:1787381600.910796:0:14160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5efcfb7/0xbdc38ada7ea10cc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.910804:0:14160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5efcfb7/0xbdc38ada7ea10cc5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.910815:0:14160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5efcfb7/0xbdc38ada7ea10cc5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.910823:0:14160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5efcfb7/0xbdc38ada7ea10cc5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381600.910845:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381600.910848:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381600.910851:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381600.913606:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787381600.913622:0:14808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c59fcf99/0xbdc38ada7ea10ccc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787381600.915417:0:14808:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787381600.915432:0:14808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003d1dc61/0xbdc38ada7ea10cd3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.915510:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=459s v=(0 0) 00010000:00010000:1.0:1787381600.915515:0:14808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787381600.915521:0:14808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003d1dc61/0xbdc38ada7ea10cd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.915545:0:14808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003d1dc61/0xbdc38ada7ea10cd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.915569:0:14808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003d1dc61/0xbdc38ada7ea10cd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381600.915577:0:14808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003d1dc61/0xbdc38ada7ea10cd3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.915762:0:15541:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787381600.915770:0:15541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003d1dc61/0xbdc38ada7ea10cd3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.915779:0:15541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388a00 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:3.0:1787381600.915783:0:15541:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003d1dc61/0xbdc38ada7ea10cd3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.915801:0:15541:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003d1dc61/0xbdc38ada7ea10cd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.915818:0:15541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003d1dc61/0xbdc38ada7ea10cd3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381600.915828:0:15541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.915829:0:15541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381600.915831:0:15541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381600.915907:0:14808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787381600.915912:0:14808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003d1dc61/0xbdc38ada7ea10cd3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1787381600.916211:0:14808:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:1.0:1787381600.916316:0:14808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14194:x1874205065970048:12345-0@lo:5:osp-pre-0-0.0 Request processed in 90473us (176954us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381600.916326:0:14808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787381600.916468:0:14194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14194:1874205065970048:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787381600.916485:0:14194:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:2.0:1787381600.916540:0:14194:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6caa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14194:1874205065970304:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787381600.916594:0:14194:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381600.916633:0:14194:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167a7e1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787381600.916653:0:14807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065970304 00000100:00100000:2.0:1787381600.916658:0:14807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065970304 00000100:00100000:2.0:1787381600.916693:0:14807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787381600.916700:0:14807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14194:x1874205065970304:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787381600.916736:0:14807:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:3.0:1787381600.921102:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787381600.925577:0:14807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14194:x1874205065970304:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8868us (8974us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787381600.925593:0:14807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787381600.925719:0:14194:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6caa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14194:1874205065970304:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787381600.925733:0:14194:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 10000000:01000000:0.0:1787381601.420152:0:14169:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787381601.420161:0:14169:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a15411ca800 from 8 10000000:01000000:0.0:1787381601.420165:0:14169:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787381601.420213:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1645bc9600/0xbdc38ada7ea10cda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381601.420226:0:14169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a1645bc9600/0xbdc38ada7ea10cda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381601.420238:0:14169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a1645bc9600/0xbdc38ada7ea10cda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381601.420264:0:14169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542863800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14169:1874205065970432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787381601.420352:0:14169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381601.420405:0:14169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1674ec8300 going to sleep for 11 seconds 00000100:00100000:1.0:1787381601.420519:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065970432 00000100:00100000:1.0:1787381601.420527:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065970432 00000100:00100000:1.0:1787381601.420579:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787381601.420588:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a396450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+18:14169:x1874205065970432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787381601.420600:0:14165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381601.420612:0:14165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1541388000/0xbdc38ada7ea10ce1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea10cda expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381601.420633:0:14165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1541388000/0xbdc38ada7ea10ce1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea10cda expref: 19 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381601.420654:0:14165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1541388000/0xbdc38ada7ea10ce1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea10cda expref: 19 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381601.420663:0:14165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541388000, rc 0) 00000100:00100000:1.0:1787381601.420708:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a396450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+19:14169:x1874205065970432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381601.420715:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787381601.420786:0:14169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542863800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14169:1874205065970432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787381601.420800:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a1645bc9600/0xbdc38ada7ea10cda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10ce1 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381601.420808:0:14169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a1645bc9600/0xbdc38ada7ea10cda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea10ce1 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381601.420856:0:14169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14169:1874205065970560:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787381601.420886:0:14169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381601.420907:0:14169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f94a540 going to sleep for 11 seconds 00000100:00100000:1.0:1787381601.420945:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065970560 00000100:00100000:1.0:1787381601.420948:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065970560 00000100:00100000:1.0:1787381601.420978:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787381601.420984:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a395850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+19:14169:x1874205065970560:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787381601.420996:0:14166:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787381601.421047:0:14166:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787381601.421050:0:14166:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1787381601.421130:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a395850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+19:14169:x1874205065970560:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 145us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381601.421137:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787381601.421492:0:14169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14169:1874205065970560:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787381601.421551:0:14169:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787381601.421558:0:14169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1645bc9600/0xbdc38ada7ea10cda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10ce1 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381601.421568:0:14169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a1645bc9600/0xbdc38ada7ea10cda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10ce1 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381601.621457:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381602.640722:0:15541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787381602.721258:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1787381602.721312:0:6614:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:1.0:1787381603.660478:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787381604.686178:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787381605.273091:0:7481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1787381605.273117:0:7481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:1.0:1787381605.713732:0:15541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787381605.932787:0:15834:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1787381606.222364:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065970688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787381606.222435:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381606.222503:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065970688 00000100:00100000:0.0:1787381606.222510:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065970688 00000100:00100000:0.0:1787381606.222558:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787381606.222566:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542862a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065970688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787381606.223717:0:14810:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787381606.223801:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542862a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065970688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1233us (1364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381606.223819:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787381606.223847:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787381606.223866:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065970816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787381606.223900:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381606.224024:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542863800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:3308:1874205065970944:0@lo:400:kworker.0 00000100:00100000:0.0:1787381606.224060:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381606.224102:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787381606.224109:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542862300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874205065971072:0@lo:400:kworker.0 00000100:00100000:0.0:1787381606.224136:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381606.224666:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065970944 00000100:00100000:0.0:1787381606.224673:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065970944 00000100:00100000:0.0:1787381606.224718:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787381606.224725:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a396c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+19:3308:x1874205065970944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381606.224828:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a396c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+19:3308:x1874205065970944:12345-0@lo:400:kworker.0 Request processed in 103us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381606.224836:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787381606.224862:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065971072 00000100:00100000:0.0:1787381606.224865:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065971072 00000100:00100000:0.0:1787381606.224899:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787381606.224907:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542860a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874205065971072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787381606.224940:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542860a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874205065971072:12345-0@lo:400:kworker.0 Request processed in 34us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381606.224947:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787381606.224969:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542860000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1874205065971328:0@lo:400:kworker.0 00000100:00100000:0.0:1787381606.225022:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381606.225060:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065971328 00000100:00100000:0.0:1787381606.225062:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787381606.225066:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065971328 00000100:00100000:0.0:1787381606.225072:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1874205065971200:0@lo:400:kworker.0 00000100:00100000:0.0:1787381606.225100:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381606.225106:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787381606.225117:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542861180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874205065971328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787381606.225164:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542861180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874205065971328:12345-0@lo:400:kworker.0 Request processed in 50us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381606.225179:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787381606.225191:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065971200 00000100:00100000:3.0:1787381606.225194:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065971200 00000100:00100000:3.0:1787381606.225209:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787381606.225214:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542860700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874205065971200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787381606.225242:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542860700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874205065971200:12345-0@lo:400:kworker.0 Request processed in 28us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381606.225259:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1787381606.225275:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787381606.225302:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a1542863b80 x1874205065971200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787381622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787381606.225314:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1874205065971200:0@lo:400:kworker.0 00010000:00080000:3.0:1787381606.225324:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a1542860000 x1874205065971328/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787381622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787381606.225333:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542860000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1874205065971328:0@lo:400:kworker.0 00000100:00100000:0.0:1787381606.226917:0:3310:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787381606.226949:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065970688:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1787381606.226990:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a1542862300 x1874205065971072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787381622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787381606.227023:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542862300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874205065971072:0@lo:400:kworker.0 00000100:00100000:0.0:1787381606.227038:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542863800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:3308:1874205065970944:0@lo:400:kworker.0 00000100:00100000:0.0:1787381606.227062:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065970816 00000100:00100000:0.0:1787381606.227068:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065970816 00000100:00100000:0.0:1787381606.227116:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787381606.227124:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542861880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065970816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787381606.227172:0:14810:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787381606.227232:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542861880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065970816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (3331us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381606.227239:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787381606.227505:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787381606.227530:0:3311:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787381606.227545:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065970816:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787381606.737052:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787381607.180782:0:14205:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787381607.756181:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787381608.272261:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381608.272342:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047103616 00000100:00100000:0.0:1787381608.272353:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047103616 00000100:00100000:0.0:1787381608.272398:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 75 00000100:00100000:0.0:1787381608.272407:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a395c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2348:x1874205047103616:12345-192.168.203.22@tcp:250:mount.lustre.0 00010000:00080000:0.0:1787381608.272435:0:14164:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from a658e7c5-3f7d-4d71-838f-01592bc16d6a@192.168.203.22@tcp t0 exp 0000000000000000 cur 466 last 0 00000020:00000080:0.0:1787381608.272464:0:14164:0:(genops.c:1406:class_connect()) connect: client a658e7c5-3f7d-4d71-838f-01592bc16d6a, cookie 0xbdc38ada7ea10ce8 00000100:00080000:0.0:1787381608.272621:0:14164:0:(import.c:65:import_set_state_nolock()) ffff9a1541a28800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787381608.272699:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a395c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a658e7c5-3f7d-4d71-838f-01592bc16d6a+5:2348:x1874205047103616:12345-192.168.203.22@tcp:250:mount.lustre.0 Request processed in 292us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381608.272720:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 75 00000100:00100000:1.0:1787381608.282809:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381608.282923:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047103744 00000100:00100000:0.0:1787381608.282934:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047103744 00000100:00100000:0.0:1787381608.282992:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 76 00000100:00100000:0.0:1787381608.283038:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a397450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a658e7c5-3f7d-4d71-838f-01592bc16d6a+5:13694:x1874205047103744:12345-192.168.203.22@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787381608.283054:0:14166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381608.283073:0:14166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1645bc8400/0xbdc38ada7ea10cef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc01952459a953aae expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381608.283277:0:14166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1645bc8400/0xbdc38ada7ea10cef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953aae expref: 6 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381608.283309:0:14166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1645bc8400/0xbdc38ada7ea10cef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953aae expref: 6 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381608.283319:0:14166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1645bc8400, rc 0) 00000100:00100000:1.0:1787381608.283395:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a397450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a658e7c5-3f7d-4d71-838f-01592bc16d6a+6:13694:x1874205047103744:12345-192.168.203.22@tcp:101:mount.lustre.0 Request processed in 388us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381608.283403:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 76 00000100:00100000:2.0:1787381608.291590:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381608.291678:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047103872 00000100:00100000:0.0:1787381608.291688:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047103872 00000100:00100000:0.0:1787381608.291742:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 77 00000100:00100000:0.0:1787381608.291752:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a396850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a658e7c5-3f7d-4d71-838f-01592bc16d6a+6:13694:x1874205047103872:12345-192.168.203.22@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787381608.292257:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a396850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a658e7c5-3f7d-4d71-838f-01592bc16d6a+6:13694:x1874205047103872:12345-192.168.203.22@tcp:501:mount.lustre.0 Request processed in 505us (673us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787381608.292267:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 77 00000100:00100000:2.0:1787381608.302880:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381608.302989:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047104000 00000100:00100000:1.0:1787381608.302999:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047104000 00000100:00100000:1.0:1787381608.303087:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 78 00000100:00100000:1.0:1787381608.303097:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a394050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a658e7c5-3f7d-4d71-838f-01592bc16d6a+6:13694:x1874205047104000:12345-192.168.203.22@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787381608.303114:0:14166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381608.303133:0:14166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1541388200/0xbdc38ada7ea10cf6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc01952459a953ab5 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381608.303160:0:14166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1541388200/0xbdc38ada7ea10cf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953ab5 expref: 7 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381608.303170:0:14166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1541388200/0xbdc38ada7ea10cf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953ab5 expref: 7 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381608.303179:0:14166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541388200, rc 0) 00000100:00100000:1.0:1787381608.303256:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a394050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a658e7c5-3f7d-4d71-838f-01592bc16d6a+7:13694:x1874205047104000:12345-192.168.203.22@tcp:101:mount.lustre.0 Request processed in 160us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381608.303263:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 78 00000100:00100000:1.0:1787381608.305650:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381608.305752:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047104128 00000100:00100000:0.0:1787381608.305762:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047104128 00000100:00100000:0.0:1787381608.305852:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 79 00000100:00100000:0.0:1787381608.305862:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a397050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a658e7c5-3f7d-4d71-838f-01592bc16d6a+7:13694:x1874205047104128:12345-192.168.203.22@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787381608.306337:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a397050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a658e7c5-3f7d-4d71-838f-01592bc16d6a+8:13694:x1874205047104128:12345-192.168.203.22@tcp:501:mount.lustre.0 Request processed in 474us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381608.306345:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 79 00000100:00100000:2.0:1787381608.311089:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381608.311228:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047104256 00000100:00100000:1.0:1787381608.311246:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047104256 00000100:00100000:1.0:1787381608.311302:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 80 00000100:00100000:1.0:1787381608.311311:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a396050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a658e7c5-3f7d-4d71-838f-01592bc16d6a+8:13694:x1874205047104256:12345-192.168.203.22@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787381608.311702:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a396050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a658e7c5-3f7d-4d71-838f-01592bc16d6a+8:13694:x1874205047104256:12345-192.168.203.22@tcp:503:mount.lustre.0 Request processed in 389us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381608.311711:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 80 00000100:00100000:2.0:1787381608.316803:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381608.317064:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047104384 00000100:00100000:0.0:1787381608.317074:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047104384 00000100:00100000:0.0:1787381608.317155:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 81 00000100:00100000:0.0:1787381608.317166:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a395450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a658e7c5-3f7d-4d71-838f-01592bc16d6a+8:13712:x1874205047104384:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787381608.317555:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a395450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a658e7c5-3f7d-4d71-838f-01592bc16d6a+8:13712:x1874205047104384:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 390us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381608.317564:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 81 00000100:00100000:2.0:1787381608.357173:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381608.357318:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047104512 00000100:00100000:3.0:1787381608.357328:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047104512 00000100:00100000:3.0:1787381608.357387:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 82 00000100:00100000:3.0:1787381608.357407:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a394850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a658e7c5-3f7d-4d71-838f-01592bc16d6a+8:13712:x1874205047104512:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787381608.357708:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a394850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a658e7c5-3f7d-4d71-838f-01592bc16d6a+8:13712:x1874205047104512:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 311us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381608.357728:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 82 00000100:00100000:2.0:1787381608.366174:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381608.366292:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047104640 00000100:00100000:1.0:1787381608.366302:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047104640 00000100:00100000:1.0:1787381608.366363:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 83 00000100:00100000:1.0:1787381608.366374:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fcbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a658e7c5-3f7d-4d71-838f-01592bc16d6a+8:13694:x1874205047104640:12345-192.168.203.22@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787381608.366390:0:14166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381608.366407:0:14166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1541389e00/0xbdc38ada7ea10cfd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc01952459a953adf expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381608.366434:0:14166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1541389e00/0xbdc38ada7ea10cfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953adf expref: 9 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381608.366445:0:14166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1541389e00/0xbdc38ada7ea10cfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953adf expref: 9 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381608.366454:0:14166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541389e00, rc 0) 00000100:00100000:1.0:1787381608.366520:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fcbb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a658e7c5-3f7d-4d71-838f-01592bc16d6a+9:13694:x1874205047104640:12345-192.168.203.22@tcp:101:mount.lustre.0 Request processed in 148us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381608.366527:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 83 00000100:00100000:2.0:1787381608.378563:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381608.378691:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047104768 00000100:00100000:0.0:1787381608.378700:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047104768 00000100:00100000:0.0:1787381608.378784:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 84 00000100:00100000:0.0:1787381608.378793:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fcba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a658e7c5-3f7d-4d71-838f-01592bc16d6a+9:13694:x1874205047104768:12345-192.168.203.22@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787381608.378817:0:14164:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787381608.378839:0:14164:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787381608.378843:0:14164:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787381608.378846:0:14164:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787381608.378848:0:14164:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787381608.385407:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fcba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a658e7c5-3f7d-4d71-838f-01592bc16d6a+9:13694:x1874205047104768:12345-192.168.203.22@tcp:256:mount.lustre.0 Request processed in 6594us (6833us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381608.385423:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 84 00000100:00100000:2.0:1787381608.388660:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381608.388760:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047104896 00000100:00100000:1.0:1787381608.388770:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047104896 00000100:00100000:1.0:1787381608.388825:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 85 00000100:00100000:1.0:1787381608.388851:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fcb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a658e7c5-3f7d-4d71-838f-01592bc16d6a+9:13694:x1874205047104896:12345-192.168.203.22@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787381608.388868:0:14166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381608.388886:0:14166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1541388800/0xbdc38ada7ea10d04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc01952459a953ae6 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381608.388925:0:14166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1541388800/0xbdc38ada7ea10d04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953ae6 expref: 10 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381608.388937:0:14166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1541388800/0xbdc38ada7ea10d04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953ae6 expref: 10 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381608.388947:0:14166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541388800, rc 0) 00000100:00100000:1.0:1787381608.389032:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fcb8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a658e7c5-3f7d-4d71-838f-01592bc16d6a+10:13694:x1874205047104896:12345-192.168.203.22@tcp:101:mount.lustre.0 Request processed in 183us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381608.389039:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 85 00000100:00100000:2.0:1787381608.391701:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381608.391788:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047105024 00000100:00100000:0.0:1787381608.391797:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047105024 00000100:00100000:0.0:1787381608.391850:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 86 00000100:00100000:0.0:1787381608.391859:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fcba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a658e7c5-3f7d-4d71-838f-01592bc16d6a+10:13694:x1874205047105024:12345-192.168.203.22@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787381608.392190:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fcba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a658e7c5-3f7d-4d71-838f-01592bc16d6a+10:13694:x1874205047105024:12345-192.168.203.22@tcp:501:mount.lustre.0 Request processed in 331us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381608.392199:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 86 00000100:00100000:2.0:1787381608.394190:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381608.394356:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047105152 00000100:00100000:3.0:1787381608.394365:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047105152 00000100:00100000:3.0:1787381608.394423:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 87 00000100:00100000:3.0:1787381608.394432:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fcbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a658e7c5-3f7d-4d71-838f-01592bc16d6a+10:13694:x1874205047105152:12345-192.168.203.22@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787381608.394803:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fcbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a658e7c5-3f7d-4d71-838f-01592bc16d6a+10:13694:x1874205047105152:12345-192.168.203.22@tcp:503:mount.lustre.0 Request processed in 370us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381608.394812:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 87 00000100:00100000:2.0:1787381608.397614:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381608.398208:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047105280 00000100:00100000:1.0:1787381608.398219:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047105280 00000100:00100000:1.0:1787381608.398284:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 88 00000100:00100000:1.0:1787381608.398294:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fcb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a658e7c5-3f7d-4d71-838f-01592bc16d6a+10:13716:x1874205047105280:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787381608.398602:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fcb9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a658e7c5-3f7d-4d71-838f-01592bc16d6a+10:13716:x1874205047105280:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 307us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381608.398610:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 88 00000100:00100000:2.0:1787381608.400553:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381608.400643:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047105408 00000100:00100000:0.0:1787381608.400652:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047105408 00000100:00100000:0.0:1787381608.400714:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 89 00000100:00100000:0.0:1787381608.400723:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fcbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a658e7c5-3f7d-4d71-838f-01592bc16d6a+10:13716:x1874205047105408:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787381608.400967:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fcbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a658e7c5-3f7d-4d71-838f-01592bc16d6a+10:13716:x1874205047105408:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 244us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381608.400975:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 89 00000100:00100000:2.0:1787381608.408528:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381608.408618:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047105536 00000100:00100000:3.0:1787381608.408628:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047105536 00000100:00100000:3.0:1787381608.408679:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:3.0:1787381608.408688:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2348:x1874205047105536:12345-192.168.203.22@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787381608.408716:0:14172:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from ce4e36ad-b3a2-4fd4-ac37-f9047c025b36@192.168.203.22@tcp t0 exp 0000000000000000 cur 466 last 0 00000020:00000080:3.0:1787381608.408766:0:14172:0:(genops.c:1406:class_connect()) connect: client ce4e36ad-b3a2-4fd4-ac37-f9047c025b36, cookie 0xbdc38ada7ea10d0b 00000004:00100000:3.0:1787381608.408797:0:14172:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1787381608.408802:0:14172:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1787381608.480848:0:14172:0:(import.c:65:import_set_state_nolock()) ffff9a1541a2d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787381608.480927:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+6:2348:x1874205047105536:12345-192.168.203.22@tcp:38:mount.lustre.0 Request processed in 72238us (72408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381608.480939:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:2.0:1787381608.485458:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381608.485559:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047105664 00000100:00100000:0.0:1787381608.485569:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047105664 00000100:00080000:3.0:1787381608.485709:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787381608.486071:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:0.0:1787381608.486084:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+6:0:x1874205047105664:12345-192.168.203.22@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787381608.486141:0:14171:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787381608.486220:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+6:0:x1874205047105664:12345-192.168.203.22@tcp:41:mount.lustre.0 Request processed in 140us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381608.486227:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:2.0:1787381608.487674:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381608.487755:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047105792 00000100:00100000:0.0:1787381608.487764:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047105792 00000100:00100000:0.0:1787381608.487814:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:0.0:1787381608.487823:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+6:13694:x1874205047105792:12345-192.168.203.22@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787381608.487848:0:14172:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787381608.487905:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+6:13694:x1874205047105792:12345-192.168.203.22@tcp:41:mount.lustre.0 Request processed in 83us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381608.487913:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:2.0:1787381608.489874:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381608.490048:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047105920 00000100:00100000:0.0:1787381608.490057:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047105920 00000100:00100000:0.0:1787381608.490120:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:0.0:1787381608.490131:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+6:13694:x1874205047105920:12345-192.168.203.22@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787381608.490216:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+6:13694:x1874205047105920:12345-192.168.203.22@tcp:40:mount.lustre.0 Request processed in 86us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381608.490224:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:2.0:1787381608.506066:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381608.506200:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047106304 00000100:00100000:1.0:1787381608.506210:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047106304 00000100:00100000:1.0:1787381608.506269:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:1.0:1787381608.506280:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+6:13694:x1874205047106304:12345-192.168.203.22@tcp:33:mount.lustre.0 00000100:00100000:2.0:1787381608.506425:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381608.506467:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381608.506549:0:14808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047106048 00000100:00100000:1.0:1787381608.506564:0:14808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047106048 00000100:00100000:1.0:1787381608.506587:0:14808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047106176 00000100:00100000:1.0:1787381608.506590:0:14808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047106176 00000100:00100000:1.0:1787381608.506608:0:14808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:1.0:1787381608.506614:0:14808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1874205047106048:12345-192.168.203.22@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787381608.506638:0:14808:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from ce4e36ad-b3a2-4fd4-ac37-f9047c025b36@192.168.203.22@tcp t0 exp 0000000000000000 cur 466 last 0 00000100:00100000:3.0:1787381608.506645:0:14805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:3.0:1787381608.506654:0:14805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1874205047106176:12345-192.168.203.22@tcp:8:mount.lustre.0 00000020:00000080:1.0:1787381608.506668:0:14808:0:(genops.c:1406:class_connect()) connect: client ce4e36ad-b3a2-4fd4-ac37-f9047c025b36, cookie 0xbdc38ada7ea10d12 00010000:00080000:3.0:1787381608.506674:0:14805:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from ce4e36ad-b3a2-4fd4-ac37-f9047c025b36@192.168.203.22@tcp t0 exp 0000000000000000 cur 466 last 0 00002000:00100000:1.0:1787381608.506680:0:14808:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ce4e36ad-b3a2-4fd4-ac37-f9047c025b36/ffff9a166fcaf000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113673 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000020:00000080:3.0:1787381608.506697:0:14805:0:(genops.c:1406:class_connect()) connect: client ce4e36ad-b3a2-4fd4-ac37-f9047c025b36, cookie 0xbdc38ada7ea10d19 00002000:00100000:3.0:1787381608.506705:0:14805:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ce4e36ad-b3a2-4fd4-ac37-f9047c025b36/ffff9a1675e5f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113673 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787381608.506706:0:14808:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00100000:3.0:1787381608.506724:0:14805:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787381608.507191:0:14805:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787381608.507225:0:14805:0:(import.c:65:import_set_state_nolock()) ffff9a1675e5e000 : changing import state from RECOVER to FULL 00002000:00080000:1.0:1787381608.507266:0:14808:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:3.0:1787381608.507308:0:14805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+6:2348:x1874205047106176:12345-192.168.203.22@tcp:8:mount.lustre.0 Request processed in 653us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381608.507316:0:14805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 7 00000004:00080000:1.0:1787381608.511268:0:14174:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4921us 00000100:00080000:1.0:1787381608.511289:0:14808:0:(import.c:65:import_set_state_nolock()) ffff9a166fca9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787381608.511359:0:14808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+6:2348:x1874205047106048:12345-192.168.203.22@tcp:8:mount.lustre.0 Request processed in 4739us (4930us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381608.511369:0:14808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 6 00000004:00200000:0.0:1787381608.527766:0:14174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787381608.527959:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+6:13694:x1874205047106304:12345-192.168.203.22@tcp:33:mount.lustre.0 Request processed in 21675us (21897us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381608.527975:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:2.0:1787381608.776611:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381608.777122:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047106432 00000100:00100000:1.0:1787381608.777132:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047106432 00000100:00100000:1.0:1787381608.777199:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:1.0:1787381608.777209:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+6:13737:x1874205047106432:12345-192.168.203.22@tcp:101:mkdir.0 00010000:00010000:1.0:1787381608.777239:0:14173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381608.777267:0:14173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388400/0xbdc38ada7ea10d20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953b10 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381608.777331:0:14173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10d27 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381608.777343:0:14173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10d27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381608.777369:0:14173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10d27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787381608.777569:0:14173:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787381608.777573:0:14173:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787381608.777667:0:14173:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10d27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381608.777695:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388400/0xbdc38ada7ea10d20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953b10 expref: 8 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381608.777715:0:14173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10d27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953b10 expref: 7 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381608.777723:0:14173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a16522d1a00) 00010000:00010000:1.0:1787381608.777726:0:14173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787381608.777729:0:14173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541388600, rc 0) 00000100:00100000:1.0:1787381608.777797:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+7:13737:x1874205047106432:12345-192.168.203.22@tcp:101:mkdir.0 Request processed in 589us (1195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381608.777805:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 8 00010000:00010000:1.0:1787381608.780723:0:15541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381609.804310:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787381610.382943:0:7481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ce4e36ad-b3a2-4fd4-ac37-f9047c025b36 00000100:00100000:2.0:1787381610.802224:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381610.802933:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047106560 00000100:00100000:3.0:1787381610.802943:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047106560 00000100:00080000:0.0:1787381610.803042:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787381610.803079:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:3.0:1787381610.803090:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+7:13789:x1874205047106560:12345-192.168.203.22@tcp:41:lfs.0 00000004:00000024:3.0:1787381610.803142:0:14172:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787381610.803321:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+7:13789:x1874205047106560:12345-192.168.203.22@tcp:41:lfs.0 Request processed in 233us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381610.803335:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:2.0:1787381610.808314:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381610.808524:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047106688 00000100:00100000:0.0:1787381610.808535:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047106688 00000100:00100000:0.0:1787381610.808617:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:0.0:1787381610.808629:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+6:13789:x1874205047106688:12345-192.168.203.22@tcp:13:lfs.0 00002000:00000024:0.0:1787381610.808681:0:14810:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787381610.808776:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+6:13789:x1874205047106688:12345-192.168.203.22@tcp:13:lfs.0 Request processed in 148us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381610.808783:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00080000:3.0:1787381610.810032:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787381610.815308:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381610.815507:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047106816 00000100:00100000:0.0:1787381610.815517:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047106816 00000100:00080000:3.0:1787381610.815645:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787381610.815949:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:0.0:1787381610.815961:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+5:13789:x1874205047106816:12345-192.168.203.22@tcp:13:lfs.0 00002000:00000024:0.0:1787381610.815997:0:14810:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787381610.816111:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+5:13789:x1874205047106816:12345-192.168.203.22@tcp:13:lfs.0 Request processed in 153us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381610.816132:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 5 00010000:00010000:2.0:1787381610.828232:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787381611.038954:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381611.039035:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047106944 00000100:00100000:3.0:1787381611.039043:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047106944 00000100:00100000:3.0:1787381611.039089:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 90 00000100:00100000:3.0:1787381611.039096:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fcba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a658e7c5-3f7d-4d71-838f-01592bc16d6a+10:13822:x1874205047106944:12345-192.168.203.22@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787381611.039115:0:14165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381611.039129:0:14165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1647eb0200/0xbdc38ada7ea10d2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc01952459a953b17 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381611.039153:0:14165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1647eb0200/0xbdc38ada7ea10d2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953b17 expref: 11 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381611.039161:0:14165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1647eb0200/0xbdc38ada7ea10d2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953b17 expref: 11 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381611.039182:0:14165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb0200, rc 0) 00000100:00100000:3.0:1787381611.039242:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fcba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a658e7c5-3f7d-4d71-838f-01592bc16d6a+11:13822:x1874205047106944:12345-192.168.203.22@tcp:101:mount.lustre.0 Request processed in 146us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381611.039249:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 90 00000100:00100000:2.0:1787381611.046539:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381611.049772:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047107072 00000100:00100000:1.0:1787381611.049788:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047107072 00000100:00100000:1.0:1787381611.049861:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 91 00000100:00100000:1.0:1787381611.049872:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166fcb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a658e7c5-3f7d-4d71-838f-01592bc16d6a+11:13822:x1874205047107072:12345-192.168.203.22@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787381611.050235:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166fcb8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a658e7c5-3f7d-4d71-838f-01592bc16d6a+11:13822:x1874205047107072:12345-192.168.203.22@tcp:501:mount.lustre.0 Request processed in 363us (3703us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381611.050243:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 91 00000100:00100000:2.0:1787381611.058209:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381611.058328:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047107200 00000100:00100000:0.0:1787381611.058338:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047107200 00000100:00100000:0.0:1787381611.058402:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 92 00000100:00100000:0.0:1787381611.058411:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646543450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a658e7c5-3f7d-4d71-838f-01592bc16d6a+11:13822:x1874205047107200:12345-192.168.203.22@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787381611.058657:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646543450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a658e7c5-3f7d-4d71-838f-01592bc16d6a+11:13822:x1874205047107200:12345-192.168.203.22@tcp:503:mount.lustre.0 Request processed in 246us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381611.058671:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 92 00000100:00100000:0.0:1787381611.070272:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381611.073952:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047107328 00000100:00100000:3.0:1787381611.073971:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047107328 00000100:00100000:3.0:1787381611.074117:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 93 00000100:00100000:3.0:1787381611.074128:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646542c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a658e7c5-3f7d-4d71-838f-01592bc16d6a+11:13828:x1874205047107328:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787381611.074465:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646542c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a658e7c5-3f7d-4d71-838f-01592bc16d6a+11:13828:x1874205047107328:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 337us (4202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381611.074474:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 93 00000100:00100000:2.0:1787381611.093104:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381611.093267:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047107456 00000100:00100000:1.0:1787381611.093277:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047107456 00000100:00100000:1.0:1787381611.093325:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 94 00000100:00100000:1.0:1787381611.093335:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646540c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a658e7c5-3f7d-4d71-838f-01592bc16d6a+11:13828:x1874205047107456:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787381611.093723:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646540c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a658e7c5-3f7d-4d71-838f-01592bc16d6a+11:13828:x1874205047107456:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 388us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381611.093731:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 94 00000100:00100000:2.0:1787381611.104169:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381611.104501:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047107584 00000100:00100000:3.0:1787381611.104512:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047107584 00000100:00100000:3.0:1787381611.104569:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 95 00000100:00100000:3.0:1787381611.104579:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646541850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a658e7c5-3f7d-4d71-838f-01592bc16d6a+11:13822:x1874205047107584:12345-192.168.203.22@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787381611.104596:0:14165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381611.104614:0:14165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1647eb0c00/0xbdc38ada7ea10d35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc01952459a953b41 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381611.104642:0:14165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1647eb0c00/0xbdc38ada7ea10d35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953b41 expref: 12 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381611.104652:0:14165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1647eb0c00/0xbdc38ada7ea10d35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953b41 expref: 12 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381611.104661:0:14165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb0c00, rc 0) 00000100:00100000:3.0:1787381611.104738:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646541850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a658e7c5-3f7d-4d71-838f-01592bc16d6a+12:13822:x1874205047107584:12345-192.168.203.22@tcp:101:mount.lustre.0 Request processed in 160us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381611.104745:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 95 00000100:00100000:0.0:1787381611.112585:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381611.114049:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047107712 00000100:00100000:1.0:1787381611.114064:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047107712 00000100:00100000:1.0:1787381611.114129:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 96 00000100:00100000:1.0:1787381611.114140:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646541450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a658e7c5-3f7d-4d71-838f-01592bc16d6a+12:13822:x1874205047107712:12345-192.168.203.22@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787381611.114170:0:14166:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787381611.114196:0:14166:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787381611.114200:0:14166:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787381611.114203:0:14166:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787381611.114205:0:14166:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1787381611.117123:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646541450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a658e7c5-3f7d-4d71-838f-01592bc16d6a+12:13822:x1874205047107712:12345-192.168.203.22@tcp:256:mount.lustre.0 Request processed in 2974us (4535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381611.117136:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 96 00000100:00100000:2.0:1787381611.122418:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381611.122548:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047107840 00000100:00100000:0.0:1787381611.122559:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047107840 00000100:00100000:0.0:1787381611.122615:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 97 00000100:00100000:0.0:1787381611.122624:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646540050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a658e7c5-3f7d-4d71-838f-01592bc16d6a+12:13822:x1874205047107840:12345-192.168.203.22@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787381611.122641:0:14164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381611.122658:0:14164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1645bc8000/0xbdc38ada7ea10d3c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc01952459a953b48 expref: -99 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381611.122684:0:14164:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1645bc8000/0xbdc38ada7ea10d3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953b48 expref: 13 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381611.122695:0:14164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1645bc8000/0xbdc38ada7ea10d3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953b48 expref: 13 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381611.122704:0:14164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1645bc8000, rc 0) 00000100:00100000:0.0:1787381611.122762:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646540050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a658e7c5-3f7d-4d71-838f-01592bc16d6a+13:13822:x1874205047107840:12345-192.168.203.22@tcp:101:mount.lustre.0 Request processed in 138us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381611.122780:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 97 00000100:00100000:0.0:1787381611.125611:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381611.125902:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047107968 00000100:00100000:1.0:1787381611.125912:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047107968 00000100:00100000:1.0:1787381611.125960:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 98 00000100:00100000:1.0:1787381611.125970:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646541c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a658e7c5-3f7d-4d71-838f-01592bc16d6a+13:13822:x1874205047107968:12345-192.168.203.22@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787381611.126550:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646541c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a658e7c5-3f7d-4d71-838f-01592bc16d6a+13:13822:x1874205047107968:12345-192.168.203.22@tcp:501:mount.lustre.0 Request processed in 578us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381611.126558:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 98 00000100:00100000:2.0:1787381611.129126:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381611.129349:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047108096 00000100:00100000:3.0:1787381611.129358:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047108096 00000100:00100000:3.0:1787381611.129423:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 99 00000100:00100000:3.0:1787381611.129432:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646542850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a658e7c5-3f7d-4d71-838f-01592bc16d6a+13:13822:x1874205047108096:12345-192.168.203.22@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787381611.129651:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646542850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a658e7c5-3f7d-4d71-838f-01592bc16d6a+13:13822:x1874205047108096:12345-192.168.203.22@tcp:503:mount.lustre.0 Request processed in 218us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381611.129659:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 99 00000100:00100000:2.0:1787381611.134200:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381611.134410:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047108224 00000100:00100000:1.0:1787381611.134419:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047108224 00000100:00100000:1.0:1787381611.134470:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 100 00000100:00100000:1.0:1787381611.134480:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646543c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a658e7c5-3f7d-4d71-838f-01592bc16d6a+13:13831:x1874205047108224:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787381611.134739:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646543c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a658e7c5-3f7d-4d71-838f-01592bc16d6a+13:13831:x1874205047108224:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 259us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381611.134746:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 100 00000100:00100000:2.0:1787381611.141160:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381611.141319:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047108352 00000100:00100000:0.0:1787381611.141329:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047108352 00000100:00100000:0.0:1787381611.141389:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 101 00000100:00100000:0.0:1787381611.141399:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646540850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a658e7c5-3f7d-4d71-838f-01592bc16d6a+13:13831:x1874205047108352:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787381611.141645:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646540850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a658e7c5-3f7d-4d71-838f-01592bc16d6a+13:13831:x1874205047108352:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 246us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381611.141654:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 101 00000100:00100000:2.0:1787381611.144739:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381611.144782:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381611.145121:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047108480 00000100:00100000:3.0:1787381611.145130:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047108480 00000100:00100000:3.0:1787381611.145163:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047108608 00000100:00100000:3.0:1787381611.145166:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047108608 00000100:00100000:3.0:1787381611.145199:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:3.0:1787381611.145208:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+7:2349:x1874205047108608:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381611.145289:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+7:2349:x1874205047108608:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 82us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381611.145297:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:3.0:1787381611.145315:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:3.0:1787381611.145319:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2348:x1874205047108480:12345-192.168.203.22@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787381611.145341:0:14171:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 8c893b2d-14df-4f4c-b3bd-3f2d594e7219@192.168.203.22@tcp t0 exp 0000000000000000 cur 469 last 0 00000020:00000080:3.0:1787381611.145408:0:14171:0:(genops.c:1406:class_connect()) connect: client 8c893b2d-14df-4f4c-b3bd-3f2d594e7219, cookie 0xbdc38ada7ea10d43 00000004:00100000:3.0:1787381611.145440:0:14171:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787381611.145549:0:14171:0:(import.c:65:import_set_state_nolock()) ffff9a16815e5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787381611.145588:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+6:2348:x1874205047108480:12345-192.168.203.22@tcp:38:mount.lustre.0 Request processed in 266us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381611.145595:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:2.0:1787381611.147037:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381611.147093:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381611.147159:0:14805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047108736 00000100:00100000:1.0:1787381611.147168:0:14805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047108736 00000100:00100000:1.0:1787381611.147225:0:14805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047108992 00000100:00100000:1.0:1787381611.147228:0:14805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047108992 00000100:00100000:1.0:1787381611.147253:0:14805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:1.0:1787381611.147262:0:14805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+6:2349:x1874205047108736:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787381611.147319:0:14805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+6:2349:x1874205047108736:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 57us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381611.147326:0:14805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:1.0:1787381611.147342:0:14805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:1.0:1787381611.147348:0:14805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+5:2349:x1874205047108992:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787381611.147384:0:14805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+5:2349:x1874205047108992:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 24us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381611.147390:0:14805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:2.0:1787381611.150959:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381611.151094:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047109120 00000100:00100000:3.0:1787381611.151105:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047109120 00000100:00100000:3.0:1787381611.151181:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:3.0:1787381611.151200:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+6:13822:x1874205047109120:12345-192.168.203.22@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787381611.151251:0:14171:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787381611.151323:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+6:13822:x1874205047109120:12345-192.168.203.22@tcp:41:mount.lustre.0 Request processed in 133us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381611.151331:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00080000:0.0:1787381611.152716:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787381611.154057:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381611.154173:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381611.154756:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047109248 00000100:00100000:1.0:1787381611.154778:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047109248 00000100:00100000:0.0:1787381611.154827:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047108864 00000100:00100000:0.0:1787381611.154830:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047108864 00000100:00100000:0.0:1787381611.154863:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:0.0:1787381611.154871:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+7:13822:x1874205047109248:12345-192.168.203.22@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787381611.154958:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+7:13822:x1874205047109248:12345-192.168.203.22@tcp:40:mount.lustre.0 Request processed in 87us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381611.154966:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:0.0:1787381611.154981:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:0.0:1787381611.154987:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+6:0:x1874205047108864:12345-192.168.203.22@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787381611.154998:0:14171:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787381611.155048:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+6:0:x1874205047108864:12345-192.168.203.22@tcp:41:mount.lustre.0 Request processed in 60us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381611.155054:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:2.0:1787381611.161241:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381611.161277:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381611.161302:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381611.161370:0:14808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047109376 00000100:00100000:3.0:1787381611.161386:0:14808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047109376 00000100:00100000:3.0:1787381611.161422:0:14808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047109504 00000100:00100000:3.0:1787381611.161426:0:14808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047109504 00000100:00100000:3.0:1787381611.161446:0:14808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:3.0:1787381611.161456:0:14808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1874205047109376:12345-192.168.203.22@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787381611.161486:0:14808:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 8c893b2d-14df-4f4c-b3bd-3f2d594e7219@192.168.203.22@tcp t0 exp 0000000000000000 cur 469 last 0 00000020:00000080:3.0:1787381611.161516:0:14808:0:(genops.c:1406:class_connect()) connect: client 8c893b2d-14df-4f4c-b3bd-3f2d594e7219, cookie 0xbdc38ada7ea10d4a 00002000:00100000:3.0:1787381611.161527:0:14808:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8c893b2d-14df-4f4c-b3bd-3f2d594e7219/ffff9a16815e1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113673 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787381611.161538:0:14808:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787381611.161644:0:14808:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787381611.161669:0:14808:0:(import.c:65:import_set_state_nolock()) ffff9a16815e4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787381611.161738:0:14808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+6:2348:x1874205047109376:12345-192.168.203.22@tcp:8:mount.lustre.0 Request processed in 282us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381611.161761:0:14808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:3.0:1787381611.161776:0:14808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:3.0:1787381611.161781:0:14808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1874205047109504:12345-192.168.203.22@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787381611.161794:0:14808:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 8c893b2d-14df-4f4c-b3bd-3f2d594e7219@192.168.203.22@tcp t0 exp 0000000000000000 cur 469 last 0 00000020:00000080:3.0:1787381611.161810:0:14808:0:(genops.c:1406:class_connect()) connect: client 8c893b2d-14df-4f4c-b3bd-3f2d594e7219, cookie 0xbdc38ada7ea10d51 00002000:00100000:3.0:1787381611.161815:0:14808:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8c893b2d-14df-4f4c-b3bd-3f2d594e7219/ffff9a16815e3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113673 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787381611.161820:0:14808:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787381611.162047:0:14808:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787381611.162062:0:14808:0:(import.c:65:import_set_state_nolock()) ffff9a16815e6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787381611.162098:0:14808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+6:2348:x1874205047109504:12345-192.168.203.22@tcp:8:mount.lustre.0 Request processed in 316us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381611.162109:0:14808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:0.0:1787381611.163185:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047109632 00000100:00100000:0.0:1787381611.163223:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047109632 00000100:00100000:0.0:1787381611.163278:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:0.0:1787381611.163287:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+6:13822:x1874205047109632:12345-192.168.203.22@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787381611.163503:0:14175:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787381611.163648:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+6:13822:x1874205047109632:12345-192.168.203.22@tcp:33:mount.lustre.0 Request processed in 361us (2368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381611.163657:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:0.0:1787381611.340325:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787381611.340346:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1542863800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065971456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787381611.340423:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381611.340483:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065971456 00000100:00100000:1.0:1787381611.340491:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065971456 00000100:00100000:0.0:1787381611.340493:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065971584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787381611.340521:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381611.340542:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065971584 00000100:00100000:1.0:1787381611.340546:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065971584 00000100:00100000:0.0:1787381611.340562:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787381611.340611:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542862300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065971456:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787381611.340616:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787381611.340620:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1787381611.340634:0:14810:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787381611.340685:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542862300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065971456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381611.340692:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787381611.340707:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787381611.340713:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542863480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065971584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787381611.340724:0:14810:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787381611.340756:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542863480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065971584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381611.340762:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787381611.340777:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1542863800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065971456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787381611.340807:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065971584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787381611.340938:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874205065971840:0@lo:400:kworker.0 00000100:00100000:3.0:1787381611.340950:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f560e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1874205065972096:0@lo:400:kworker.0 00000100:00100000:1.0:1787381611.340977:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381611.340999:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065971840 00000100:00100000:3.0:1787381611.341023:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065971840 00000100:00100000:1.0:1787381611.341035:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787381611.341044:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:3311:1874205065971712:0@lo:400:kworker.0 00000100:00100000:3.0:1787381611.341060:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787381611.341069:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874205065971840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381611.341077:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381611.341148:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1874205065971968:0@lo:400:kworker.0 00000100:00100000:1.0:1787381611.341151:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065971712 00000100:00100000:1.0:1787381611.341157:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065971712 00000100:00100000:1.0:1787381611.341186:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787381611.341191:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381611.341197:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646541050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+19:3311:x1874205065971712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381611.341247:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381611.341255:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646541050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+19:3311:x1874205065971712:12345-0@lo:400:kworker.0 Request processed in 58us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381611.341263:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787381611.341299:0:14173:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787381611.341306:0:14173:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1787381611.341326:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874205065971840:12345-0@lo:400:kworker.0 Request processed in 257us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381611.341338:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787381611.341353:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065971968 00000100:00100000:3.0:1787381611.341357:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065971968 00000100:00100000:3.0:1787381611.341382:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065972096 00000100:00100000:3.0:1787381611.341385:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065972096 00000100:00100000:3.0:1787381611.341417:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787381611.341423:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874205065971968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787381611.341466:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1874205065971968:12345-0@lo:400:kworker.0 Request processed in 43us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381611.341472:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787381611.341487:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787381611.341490:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874205065971840:0@lo:400:kworker.0 00000100:00100000:3.0:1787381611.341498:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874205065972096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381611.341515:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:3311:1874205065971712:0@lo:400:kworker.0 00000100:00100000:3.0:1787381611.341538:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874205065972096:12345-0@lo:400:kworker.0 Request processed in 43us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381611.341545:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787381611.341570:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1874205065971968:0@lo:400:kworker.0 00000100:00100000:3.0:1787381611.341582:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f560e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1874205065972096:0@lo:400:kworker.0 00000100:00080000:2.0:1787381611.341591:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787381611.384311:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381611.384425:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047109760 00000100:00100000:3.0:1787381611.384435:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047109760 00000100:00100000:3.0:1787381611.384503:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:3.0:1787381611.384512:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+6:13852:x1874205047109760:12345-192.168.203.22@tcp:101:mkdir.0 00010000:00010000:3.0:1787381611.384531:0:14172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381611.384552:0:14172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0e00/0xbdc38ada7ea10d58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953b72 expref: -99 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381611.384632:0:14172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea10d5f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381611.384645:0:14172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea10d5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381611.384666:0:14172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea10d5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787381611.384883:0:14172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787381611.384888:0:14172:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787381611.384975:0:14172:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea10d5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381611.385036:0:14172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0e00/0xbdc38ada7ea10d58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953b72 expref: 8 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381611.385055:0:14172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea10d5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953b72 expref: 7 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381611.385064:0:14172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a16522d1a00) 00010000:00010000:3.0:1787381611.385067:0:14172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787381611.385070:0:14172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb1c00, rc 0) 00000100:00100000:3.0:1787381611.385143:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+7:13852:x1874205047109760:12345-192.168.203.22@tcp:101:mkdir.0 Request processed in 631us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381611.385151:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 14 00010000:00010000:1.0:1787381611.852292:0:15541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381612.876358:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787381612.952161:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ce4e36ad-b3a2-4fd4-ac37-f9047c025b36 00000001:00100000:3.0:1787381612.952180:0:6614:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8c893b2d-14df-4f4c-b3bd-3f2d594e7219 00010000:00010000:0.0:1787381613.900487:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787381613.971624:0:5813:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ce4e36ad-b3a2-4fd4-ac37-f9047c025b36 00000001:00100000:2.0:1787381613.971733:0:5813:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8c893b2d-14df-4f4c-b3bd-3f2d594e7219 00000001:02000400:0.0:1787381614.169128:0:16040:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787381614.925759:0:15541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787381615.516257:0:7481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8c893b2d-14df-4f4c-b3bd-3f2d594e7219 00010000:00010000:3.0:1787381615.952642:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787381616.265993:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381616.266359:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381616.266409:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381616.266608:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047110400 00000100:00100000:0.0:1787381616.266617:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047110400 00000100:00100000:0.0:1787381616.266680:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:0.0:1787381616.266691:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+6:2349:x1874205047110400:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787381616.266759:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+6:2349:x1874205047110400:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 70us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381616.266765:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:3.0:1787381616.266875:0:14808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047110144 00000100:00100000:3.0:1787381616.266879:0:14808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047110144 00000100:00100000:3.0:1787381616.266917:0:14808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:3.0:1787381616.266924:0:14808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+5:2349:x1874205047110144:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381616.266950:0:14808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+5:2349:x1874205047110144:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 28us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381616.266966:0:14808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00080000:2.0:1787381616.268090:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787381616.268098:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787381616.269352:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381616.269400:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381616.269645:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047110016 00000100:00100000:3.0:1787381616.269654:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047110016 00000100:00100000:3.0:1787381616.269719:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:3.0:1787381616.269729:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+6:2349:x1874205047110016:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381616.269792:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+6:2349:x1874205047110016:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 65us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381616.269799:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:2.0:1787381616.270030:0:14807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047110656 00000100:00100000:2.0:1787381616.270034:0:14807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047110656 00000100:00100000:2.0:1787381616.270069:0:14807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 3 00000100:00100000:2.0:1787381616.270076:0:14807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542863800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+5:2349:x1874205047110656:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787381616.270104:0:14807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542863800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+5:2349:x1874205047110656:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 29us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381616.270111:0:14807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 3 00000100:00080000:0.0:1787381616.271117:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787381616.271124:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787381616.274406:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047109888 00000100:00100000:1.0:1787381616.274447:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047109888 00000100:00100000:1.0:1787381616.274526:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 103 00000100:00100000:1.0:1787381616.274536:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646540450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a658e7c5-3f7d-4d71-838f-01592bc16d6a+13:2349:x1874205047109888:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787381616.274617:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646540450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a658e7c5-3f7d-4d71-838f-01592bc16d6a+13:2349:x1874205047109888:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 83us (8633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381616.274625:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 103 00000100:00100000:0.0:1787381616.276968:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381616.277043:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381616.277206:0:15543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047110272 00000100:00100000:1.0:1787381616.277216:0:15543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047110272 00000100:00100000:1.0:1787381616.277283:0:15543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047110528 00000100:00100000:1.0:1787381616.277287:0:15543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047110528 00000100:00100000:1.0:1787381616.277311:0:15543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:1.0:1787381616.277320:0:15543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542863b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+5:2349:x1874205047110272:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787381616.277601:0:14807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:2.0:1787381616.277613:0:14807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+5:2349:x1874205047110528:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787381616.277678:0:14807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+5:2349:x1874205047110528:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 68us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381616.277686:0:14807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:1.0:1787381616.277955:0:15543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542863b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+5:2349:x1874205047110272:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 633us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381616.277962:0:15543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00080000:0.0:1787381616.278736:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787381616.278743:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787381616.465268:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065972352:0@lo:400:kworker.0 00000100:00100000:2.0:1787381616.465337:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381616.465383:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1874205065972864:0@lo:400:kworker.0 00000100:00100000:2.0:1787381616.465413:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381616.465437:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787381616.465443:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:3311:1874205065972224:0@lo:400:kworker.0 00000100:00100000:2.0:1787381616.465470:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381616.465490:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1874205065972736:0@lo:400:kworker.0 00000100:00100000:2.0:1787381616.465508:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381616.465531:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065972480:0@lo:400:kworker.0 00000100:00100000:2.0:1787381616.465581:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381616.465603:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787381616.465608:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874205065972608:0@lo:400:kworker.0 00000100:00100000:2.0:1787381616.465627:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381616.465656:0:14807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065972352 00000100:00100000:2.0:1787381616.465663:0:14807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065972352 00000100:00100000:2.0:1787381616.465720:0:14807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065972480 00000100:00100000:2.0:1787381616.465724:0:14807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065972480 00000100:00100000:2.0:1787381616.465747:0:14807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787381616.465755:0:14807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065972352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381616.465802:0:14807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065972352:12345-0@lo:400:kworker.0 Request processed in 47us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381616.465809:0:14807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787381616.465824:0:14807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787381616.465829:0:14807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065972480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381616.465855:0:14807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065972480:12345-0@lo:400:kworker.0 Request processed in 25us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381616.465860:0:14807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787381616.465876:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065972864 00000100:00100000:2.0:1787381616.465878:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065972864 00000100:00100000:2.0:1787381616.465899:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065972736 00000100:00100000:2.0:1787381616.465901:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065972736 00000100:00100000:2.0:1787381616.465912:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065972608 00000100:00100000:2.0:1787381616.465915:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065972608 00000100:00100000:2.0:1787381616.465925:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787381616.465930:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874205065972864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381616.465957:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874205065972864:12345-0@lo:400:kworker.0 Request processed in 26us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381616.465973:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787381616.465986:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787381616.465992:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874205065972736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381616.466043:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874205065972736:12345-0@lo:400:kworker.0 Request processed in 51us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381616.466048:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787381616.466059:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787381616.466065:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874205065972608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381616.466088:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874205065972608:12345-0@lo:400:kworker.0 Request processed in 24us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381616.466095:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787381616.466112:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065972224 00000100:00100000:2.0:1787381616.466115:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065972224 00000100:00100000:2.0:1787381616.466137:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787381616.466142:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646542450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+19:3311:x1874205065972224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787381616.466168:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646542450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+19:3311:x1874205065972224:12345-0@lo:400:kworker.0 Request processed in 26us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381616.466174:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:2.0:1787381616.466219:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787381616.466224:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787381616.466226:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787381616.466264:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874205065972608:0@lo:400:kworker.0 00000100:00100000:2.0:1787381616.466275:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065972480:0@lo:400:kworker.0 00000100:00100000:2.0:1787381616.466301:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:3311:1874205065972224:0@lo:400:kworker.0 00000100:00100000:2.0:1787381616.466322:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1874205065972736:0@lo:400:kworker.0 00000100:00100000:2.0:1787381616.466332:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065972352:0@lo:400:kworker.0 00000100:00100000:2.0:1787381616.466340:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1874205065972864:0@lo:400:kworker.0 00000100:00100000:2.0:1787381616.470407:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787381616.470429:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065972992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787381616.470495:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381616.470742:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065972992 00000100:00100000:1.0:1787381616.470749:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065972992 00000100:00100000:1.0:1787381616.470803:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787381616.470812:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065972992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787381616.470846:0:14809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787381616.470895:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065972992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381616.470902:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787381616.470945:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065972992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787381616.473249:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f560e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065973120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787381616.473316:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381616.477896:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065973120 00000100:00100000:2.0:1787381616.477912:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065973120 00000100:00100000:2.0:1787381616.477979:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787381616.477989:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065973120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787381616.478045:0:14809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787381616.491158:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065973120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 13161us (17832us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381616.491184:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787381616.492346:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f560e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065973120:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787381616.974040:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787381617.420549:0:14205:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:3.0:1787381617.789541:0:16188:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffed4669600 00000020:00000080:3.0:1787381617.789557:0:16188:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:3.0:1787381617.789563:0:16188:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:3.0:1787381617.789572:0:16188:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffed466b890 20000000:00000080:3.0:1787381617.789579:0:16188:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a167f2de800 uarg=0000000000000000 20000000:01000000:3.0:1787381617.789618:0:16188:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787381617.789624:0:16188:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787381617.789628:0:16188:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787381617.797597:0:16189:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1787381617.798345:0:16188:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787381617.808214:0:16188:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787381617.808542:0:16188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a16413a0a00/0xbdc38ada7ea10d66 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381617.808563:0:16188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a1647eb0600/0xbdc38ada7ea10a5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea10a56 expref: 18 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381617.808570:0:16188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a1647eb1600/0xbdc38ada7ea10aaa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea10aa3 expref: 18 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381617.808576:0:16188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a16413a0600/0xbdc38ada7ea10b1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea10b13 expref: 18 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381617.808585:0:16188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a1541388800/0xbdc38ada7ea10d04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953ae6 expref: 12 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381617.808605:0:16188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a1645bc8000/0xbdc38ada7ea10d3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953b48 expref: 12 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381617.808612:0:16188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a16413a0a00/0xbdc38ada7ea10d66 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381617.808650:0:16188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a1645bc8000/0xbdc38ada7ea10d3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953b48 expref: 12 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381617.808664:0:16188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a1645bc8000/0xbdc38ada7ea10d3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953b48 expref: 12 pid: 14164 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381617.808679:0:16188:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16188:1874205065973248:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787381617.808789:0:16188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a1541388800/0xbdc38ada7ea10d04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953ae6 expref: 12 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381617.808797:0:16188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a1541388800/0xbdc38ada7ea10d04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953ae6 expref: 12 pid: 14166 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381617.808805:0:16188:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16188:1874205065973376:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787381617.808833:0:16188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a16413a0600/0xbdc38ada7ea10b1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbdc38ada7ea10b13 expref: 18 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381617.808840:0:16188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a16413a0600/0xbdc38ada7ea10b1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbdc38ada7ea10b13 expref: 18 pid: 14165 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381617.808849:0:16188:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16188:1874205065973504:0@lo:104: 00000100:00100000:2.0:1787381617.808897:0:16188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787381617.808991:0:16188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a1647eb1600/0xbdc38ada7ea10aaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbdc38ada7ea10aa3 expref: 18 pid: 14164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381617.808999:0:16188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a1647eb1600/0xbdc38ada7ea10aaa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbdc38ada7ea10aa3 expref: 18 pid: 14164 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381617.809024:0:16188:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16188:1874205065973632:0@lo:104: 00000100:00100000:2.0:1787381617.809045:0:16188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787381617.813498:0:16188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a1647eb0600/0xbdc38ada7ea10a5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xbdc38ada7ea10a56 expref: 18 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381617.813515:0:16188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a1647eb0600/0xbdc38ada7ea10a5d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xbdc38ada7ea10a56 expref: 18 pid: 14166 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381617.813529:0:16188:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16188:1874205065973760:0@lo:104: 00000100:00100000:2.0:1787381617.813579:0:16188:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381617.813663:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065973504 00000100:00100000:1.0:1787381617.813671:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065973504 00000100:00100000:1.0:1787381617.813776:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065973632 00000100:00100000:1.0:1787381617.813780:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065973632 00000100:00100000:1.0:1787381617.813794:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787381617.813802:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+4:16188:x1874205065973504:12345-0@lo:104: 00010000:00010000:1.0:1787381617.814100:0:14155:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9a16460c9e00/0xbdc38ada7ea10b13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea10b1a expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381617.814148:0:14155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787381617.814154:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+4:16188:x1874205065973504:12345-0@lo:104: Request processed in 353us (5257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381617.814162:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787381617.814194:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787381617.814201:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+3:16188:x1874205065973632:12345-0@lo:104: 00010000:00010000:1.0:1787381617.814218:0:14155:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9a16413a0800/0xbdc38ada7ea10aa3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea10aaa expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381617.814249:0:14155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787381617.814254:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+3:16188:x1874205065973632:12345-0@lo:104: Request processed in 54us (5209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381617.814258:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787381617.814797:0:16188:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167a3726c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787381617.815215:0:14155:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787381617.815229:0:14155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065973760 00000100:00100000:1.0:1787381617.815235:0:14155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065973760 00000100:00100000:1.0:1787381617.815277:0:14155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787381617.815283:0:14155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167ffaf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+3:16188:x1874205065973760:12345-0@lo:104: 00000100:00100000:2.0:1787381617.815389:0:16188:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16188:1874205065973248:192.168.203.22@tcp:104: 00000100:00100000:2.0:1787381617.815402:0:16188:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16188:1874205065973376:192.168.203.22@tcp:104: 00000100:00100000:2.0:1787381617.815410:0:16188:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16188:1874205065973504:0@lo:104: 00000100:00100000:2.0:1787381617.815417:0:16188:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16188:1874205065973632:0@lo:104: 00010000:00010000:1.0:1787381617.816255:0:14155:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea10a56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea10a5d expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381617.816504:0:14155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787381617.816515:0:14155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167ffaf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+3:16188:x1874205065973760:12345-0@lo:104: Request processed in 1229us (2932us total) trans 0 rc 0/0 00010000:00010000:0.0:1787381617.816515:0:15541:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:1.0:1787381617.816526:0:14155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1787381617.816533:0:15541:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a16460c9e00/0xbdc38ada7ea10b13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea10b1a expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381617.816544:0:15541:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16460c9e00 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:0.0:1787381617.816549:0:15541:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a16460c9e00/0xbdc38ada7ea10b13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xbdc38ada7ea10b1a expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381617.816576:0:15541:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a16460c9e00/0xbdc38ada7ea10b13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xbdc38ada7ea10b1a expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381617.816588:0:14160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787381617.816593:0:14160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a16413a0800/0xbdc38ada7ea10aa3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea10aaa expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787381617.816600:0:15541:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a16460c9e00/0xbdc38ada7ea10b13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xbdc38ada7ea10b1a expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381617.816604:0:14160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a0800 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:1.0:1787381617.816610:0:14160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a16413a0800/0xbdc38ada7ea10aa3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xbdc38ada7ea10aaa expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381617.816618:0:14160:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a16413a0800/0xbdc38ada7ea10aa3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xbdc38ada7ea10aaa expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787381617.816624:0:15541:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:00010000:1.0:1787381617.816628:0:14160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a16413a0800/0xbdc38ada7ea10aa3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xbdc38ada7ea10aaa expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787381617.816633:0:14160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787381617.816679:0:14160:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a16413a0800/0xbdc38ada7ea10aa3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea10aaa expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381617.816688:0:15541:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a16460c9e00/0xbdc38ada7ea10b13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea10b1a expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381617.816703:0:14160:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787381617.816712:0:15541:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787381617.816732:0:14160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a16413a0800/0xbdc38ada7ea10aa3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea10aaa expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381617.816750:0:14160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a16413a0800/0xbdc38ada7ea10aa3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea10aaa expref: -99 pid: 14804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381617.816763:0:14160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787381617.816767:0:14160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea10a56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xbdc38ada7ea10a5d expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381617.816772:0:14160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541389400 already unused, calling callback (ffffffffc1dc3c20) 10000000:00010000:1.0:1787381617.816775:0:14160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea10a56 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xbdc38ada7ea10a5d expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381617.816782:0:14160:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea10a56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xbdc38ada7ea10a5d expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787381617.816787:0:14160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea10a56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xbdc38ada7ea10a5d expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787381617.816792:0:14160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787381617.816807:0:14160:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea10a56 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea10a5d expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381617.816996:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381617.817193:0:14160:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787381617.817211:0:14160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea10a56 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea10a5d expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381617.817218:0:14160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a1541389400/0xbdc38ada7ea10a56 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea10a5d expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381617.817228:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381617.817235:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381617.817237:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787381617.817245:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787381617.817261:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:3309:1874205065974144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787381617.817321:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381617.817389:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065974144 00000100:00100000:1.0:1787381617.817396:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065974144 00010000:00010000:1.0:1787381617.817424:0:14157:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a1647eb0600/0xbdc38ada7ea10a5d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea10a56 expref: 19 pid: 14166 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381617.817450:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787381617.817459:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+19:3309:x1874205065974144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787381617.817470:0:14157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381617.817488:0:14157:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a1647eb0600/0xbdc38ada7ea10a5d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea10a56 expref: 19 pid: 14166 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381617.817498:0:14157:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a1647eb0600/0xbdc38ada7ea10a5d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbdc38ada7ea10a56 expref: 19 pid: 14166 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381617.817518:0:14157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381617.817551:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+19:3309:x1874205065974144:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381617.817557:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787381617.817597:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:3309:1874205065974144:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787381617.818154:0:16188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1647eb0600/0xbdc38ada7ea10a5d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbdc38ada7ea10a56 expref: 18 pid: 14166 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381617.818179:0:16188:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16188:1874205065973760:0@lo:104: 00010000:00010000:2.0:1787381617.818212:0:16188:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a16413a0a00/0xbdc38ada7ea10d66 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381617.818234:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a5c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:3311:1874205065974016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787381617.818279:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381617.818441:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065974016 00000100:00100000:1.0:1787381617.818447:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065974016 00010000:00010000:1.0:1787381617.818471:0:14156:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a16413a0600/0xbdc38ada7ea10b1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea10b13 expref: 18 pid: 14165 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381617.818485:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:3310:1874205065973888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787381617.818516:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381617.818571:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065973888 00000100:00100000:1.0:1787381617.818581:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065973888 00000100:00100000:3.0:1787381617.818587:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00010000:00010000:1.0:1787381617.818600:0:14156:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a1647eb1600/0xbdc38ada7ea10aaa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea10aa3 expref: 19 pid: 14164 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381617.818611:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381617.818618:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047110784 00000100:00100000:1.0:1787381617.818622:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047110784 00000100:00100000:3.0:1787381617.818630:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047110912 00000100:00100000:3.0:1787381617.818635:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047110912 00010000:00010000:1.0:1787381617.818637:0:14156:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a1645bc8000/0xbdc38ada7ea10d3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953b48 expref: 13 pid: 14164 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381617.818656:0:14157:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a1541388800/0xbdc38ada7ea10d04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953ae6 expref: 14 pid: 14166 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381617.818657:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787381617.818666:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+19:3311:x1874205065974016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787381617.818675:0:14156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381617.818680:0:14156:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a16413a0600/0xbdc38ada7ea10b1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea10b13 expref: 19 pid: 14165 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381617.818763:0:14156:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a16413a0600/0xbdc38ada7ea10b1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbdc38ada7ea10b13 expref: 19 pid: 14165 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381617.818779:0:14156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a16413a0600/0xbdc38ada7ea10b1a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbdc38ada7ea10b13 expref: 19 pid: 14165 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381617.818791:0:14156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787381617.818961:0:14157:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787381617.818968:0:14157:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1787381617.819417:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+18:3311:x1874205065974016:12345-0@lo:103:ldlm_bl.0 Request processed in 750us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381617.819426:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787381617.819444:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787381617.819451:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f686850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+17:3310:x1874205065973888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787381617.819460:0:14156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381617.819465:0:14156:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a1647eb1600/0xbdc38ada7ea10aaa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xbdc38ada7ea10aa3 expref: 17 pid: 14164 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381617.819556:0:14156:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a1647eb1600/0xbdc38ada7ea10aaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xbdc38ada7ea10aa3 expref: 17 pid: 14164 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381617.819568:0:14156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1647eb1600/0xbdc38ada7ea10aaa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xbdc38ada7ea10aa3 expref: 17 pid: 14164 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381617.819578:0:14156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381617.819617:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f686850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+16:3310:x1874205065973888:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381617.819623:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787381617.819667:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:1.0:1787381617.819674:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f561180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a658e7c5-3f7d-4d71-838f-01592bc16d6a+14:2350:x1874205047110784:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787381617.819682:0:14156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381617.819755:0:14156:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a1645bc8000/0xbdc38ada7ea10d3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953b48 expref: 14 pid: 14164 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381617.819766:0:14156:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a1645bc8000/0xbdc38ada7ea10d3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953b48 expref: 14 pid: 14164 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381617.819777:0:14156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1645bc8000/0xbdc38ada7ea10d3c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953b48 expref: 14 pid: 14164 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381617.819786:0:14156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381617.820207:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f561180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a658e7c5-3f7d-4d71-838f-01592bc16d6a+13:2350:x1874205047110784:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 531us (1621us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381617.820215:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:1.0:1787381617.820230:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:1.0:1787381617.820245:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f560380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a658e7c5-3f7d-4d71-838f-01592bc16d6a+12:2352:x1874205047110912:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787381617.820253:0:14156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381617.820258:0:14156:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a1541388800/0xbdc38ada7ea10d04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953ae6 expref: 12 pid: 14166 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381617.820268:0:14156:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a1541388800/0xbdc38ada7ea10d04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953ae6 expref: 12 pid: 14166 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381617.820279:0:14156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a1541388800/0xbdc38ada7ea10d04 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953ae6 expref: 12 pid: 14166 timeout: 575 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381617.820291:0:14156:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a16413a0a00/0xbdc38ada7ea10d66 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381617.820373:0:14156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a16413a0a00/0xbdc38ada7ea10d66 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381617.820389:0:14156:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a16413a0a00/0xbdc38ada7ea10d66 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381617.820396:0:14156:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a16413a0a00/0xbdc38ada7ea10d66 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381617.820402:0:14156:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a16413a0a00/0xbdc38ada7ea10d66 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381617.820408:0:14156:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a16413a0a00/0xbdc38ada7ea10d66 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381617.820414:0:14156:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a0a00 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:1.0:1787381617.820418:0:14156:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a16413a0a00/0xbdc38ada7ea10d66 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381617.820432:0:14156:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a16413a0a00/0xbdc38ada7ea10d66 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381617.820442:0:14156:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a16413a0a00/0xbdc38ada7ea10d66 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381617.820452:0:14156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381617.820473:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f560380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a658e7c5-3f7d-4d71-838f-01592bc16d6a+11:2352:x1874205047110912:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 229us (1862us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381617.820585:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a5c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:3311:1874205065974016:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787381617.820619:0:16188:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a16413a0a00/0xbdc38ada7ea10d66 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381617.820626:0:16188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a16413a0a00/0xbdc38ada7ea10d66 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381617.820632:0:16188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a16413a0a00/0xbdc38ada7ea10d66 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381617.820769:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:3.0:1787381617.821470:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:3310:1874205065973888:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787381617.822229:0:15541:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9a16460c9e00/0xbdc38ada7ea10b13 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea10b1a expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381617.822245:0:15541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9a16460c9e00/0xbdc38ada7ea10b13 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xbdc38ada7ea10b1a expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381617.822263:0:15541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381617.822266:0:15541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787381617.822269:0:15541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381618.005103:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381619.022530:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787381619.215537:0:14169:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787381619.215545:0:14169:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a1646075800 from 10 10000000:01000000:0.0:1787381619.215550:0:14169:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787381619.215597:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1645bc8800/0xbdc38ada7ea10d6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381619.215609:0:14169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a1645bc8800/0xbdc38ada7ea10d6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381619.215620:0:14169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a1645bc8800/0xbdc38ada7ea10d6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381619.215647:0:14169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a5c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14169:1874205065974272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787381619.215723:0:14169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381619.215822:0:14169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16459d1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787381619.215865:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065974272 00000100:00100000:2.0:1787381619.215873:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065974272 00000100:00100000:2.0:1787381619.215960:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787381619.215972:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+16:14169:x1874205065974272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787381619.215986:0:14165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381619.216021:0:14165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a16413a0e00/0xbdc38ada7ea10d74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea10d6d expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381619.216046:0:14165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a16413a0e00/0xbdc38ada7ea10d74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea10d6d expref: 17 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381619.216058:0:14165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a16413a0e00/0xbdc38ada7ea10d74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea10d6d expref: 17 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381619.216067:0:14165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16413a0e00, rc 0) 00000100:00100000:2.0:1787381619.216116:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646543850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+17:14169:x1874205065974272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381619.216125:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787381619.216241:0:14169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a5c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14169:1874205065974272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787381619.216259:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a1645bc8800/0xbdc38ada7ea10d6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10d74 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381619.216275:0:14169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a1645bc8800/0xbdc38ada7ea10d6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea10d74 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381619.216332:0:14169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a5c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14169:1874205065974400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787381619.216365:0:14169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381619.216405:0:14169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16459d1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787381619.216427:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065974400 00000100:00100000:0.0:1787381619.216431:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065974400 00000100:00100000:0.0:1787381619.216466:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787381619.216475:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1646543050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+17:14169:x1874205065974400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787381619.216711:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1646543050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+17:14169:x1874205065974400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 238us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381619.216718:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787381619.216747:0:14169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a5c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14169:1874205065974400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787381619.216773:0:14169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a5c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14169:1874205065974528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787381619.216807:0:14169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381619.216819:0:14169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16459d1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787381619.216829:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065974528 00000100:00100000:0.0:1787381619.216832:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065974528 00000100:00100000:0.0:1787381619.216852:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787381619.216857:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1650861450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+17:14169:x1874205065974528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787381619.216984:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1650861450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+17:14169:x1874205065974528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381619.216990:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787381619.217048:0:14169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a5c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14169:1874205065974528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787381619.217607:0:16230:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787381619.217658:0:14169:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787381619.217674:0:14169:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787381619.217682:0:14169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1645bc8800/0xbdc38ada7ea10d6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10d74 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381619.217691:0:14169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a1645bc8800/0xbdc38ada7ea10d6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10d74 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787381619.217700:0:14169:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787381619.217702:0:14169:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a1644e4b000 from 10 10000000:01000000:0.0:1787381619.217705:0:14169:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787381619.217727:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1645bc9c00/0xbdc38ada7ea10d7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381619.217734:0:14169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a1645bc9c00/0xbdc38ada7ea10d7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381619.217741:0:14169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a1645bc9c00/0xbdc38ada7ea10d7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381619.217757:0:14169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a5c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14169:1874205065974656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787381619.217789:0:14169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381619.217814:0:14169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1674ec8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787381619.217828:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065974656 00000100:00100000:0.0:1787381619.217832:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065974656 00000100:00100000:0.0:1787381619.217856:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787381619.217864:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1650860c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+17:14169:x1874205065974656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787381619.217882:0:14166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381619.217893:0:14166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a1645bc8200/0xbdc38ada7ea10d82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea10d7b expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381619.217910:0:14166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a1645bc8200/0xbdc38ada7ea10d82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea10d7b expref: 18 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381619.217919:0:14166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a1645bc8200/0xbdc38ada7ea10d82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea10d7b expref: 18 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381619.217927:0:14166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1645bc8200, rc 0) 00000100:00100000:0.0:1787381619.217956:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1650860c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+18:14169:x1874205065974656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381619.217963:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787381619.217995:0:14169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a5c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14169:1874205065974656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787381619.218023:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a1645bc9c00/0xbdc38ada7ea10d7b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10d82 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381619.218032:0:14169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a1645bc9c00/0xbdc38ada7ea10d7b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea10d82 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381619.218068:0:14169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a5c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14169:1874205065974784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787381619.218090:0:14169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381619.218102:0:14169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16459d1180 going to sleep for 11 seconds 00000100:00100000:0.0:1787381619.218112:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065974784 00000100:00100000:0.0:1787381619.218115:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065974784 00000100:00100000:0.0:1787381619.218132:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787381619.218137:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1650861c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+18:14169:x1874205065974784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787381619.218370:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1650861c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+18:14169:x1874205065974784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 230us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381619.218379:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787381619.218425:0:14169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a5c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14169:1874205065974784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787381619.218458:0:14169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a5c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14169:1874205065974912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787381619.218503:0:14169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381619.218540:0:14169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a16459d1180 going to sleep for 11 seconds 00000100:00100000:0.0:1787381619.218559:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065974912 00000100:00100000:0.0:1787381619.218563:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065974912 00000100:00100000:0.0:1787381619.218590:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787381619.218595:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1650863c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+18:14169:x1874205065974912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787381619.218707:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1650863c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+18:14169:x1874205065974912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 111us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381619.218713:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787381619.218748:0:14169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a5c8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14169:1874205065974912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787381619.222461:0:16231:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787381619.222630:0:14169:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787381619.222654:0:14169:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787381619.222664:0:14169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1645bc9c00/0xbdc38ada7ea10d7b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10d82 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381619.222675:0:14169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a1645bc9c00/0xbdc38ada7ea10d7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10d82 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787381619.222685:0:14169:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787381619.222687:0:14169:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a15411ca800 from 10 10000000:01000000:3.0:1787381619.222690:0:14169:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787381619.222726:0:14169:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1e00/0xbdc38ada7ea10d89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381619.222735:0:14169:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1e00/0xbdc38ada7ea10d89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381619.222746:0:14169:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1e00/0xbdc38ada7ea10d89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381619.222772:0:14169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f561500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14169:1874205065975040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787381619.222838:0:14169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381619.222888:0:14169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1646e78540 going to sleep for 11 seconds 00000100:00100000:2.0:1787381619.222942:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065975040 00000100:00100000:2.0:1787381619.222949:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065975040 00000100:00100000:2.0:1787381619.222999:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787381619.223025:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16799c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+18:14169:x1874205065975040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787381619.223038:0:14166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381619.223050:0:14166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a16413a1000/0xbdc38ada7ea10d90 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbdc38ada7ea10d89 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381619.223074:0:14166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a16413a1000/0xbdc38ada7ea10d90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xbdc38ada7ea10d89 expref: 19 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381619.223085:0:14166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a16413a1000/0xbdc38ada7ea10d90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xbdc38ada7ea10d89 expref: 19 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381619.223093:0:14166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16413a1000, rc 0) 00000100:00100000:2.0:1787381619.223131:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16799c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+19:14169:x1874205065975040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381619.223138:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787381619.223252:0:14169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f561500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14169:1874205065975040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787381619.223273:0:14169:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1e00/0xbdc38ada7ea10d89 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10d90 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381619.223281:0:14169:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1e00/0xbdc38ada7ea10d89 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xbdc38ada7ea10d90 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381619.223330:0:14169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f561500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14169:1874205065975168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787381619.223355:0:14169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381619.223380:0:14169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1646e78540 going to sleep for 11 seconds 00000100:00100000:2.0:1787381619.223459:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065975168 00000100:00100000:2.0:1787381619.223464:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065975168 00000100:00100000:2.0:1787381619.223494:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787381619.223500:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16799cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+19:14169:x1874205065975168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787381619.223728:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16799cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+19:14169:x1874205065975168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 227us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381619.223735:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787381619.223796:0:14169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f561500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14169:1874205065975168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787381619.223816:0:14169:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f561500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14169:1874205065975296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787381619.223843:0:14169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381619.223861:0:14169:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1646e78540 going to sleep for 11 seconds 00000100:00100000:3.0:1787381619.223873:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065975296 00000100:00100000:3.0:1787381619.223876:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065975296 00000100:00100000:3.0:1787381619.223899:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787381619.223904:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16799c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+19:14169:x1874205065975296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787381619.224073:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16799c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+19:14169:x1874205065975296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381619.224080:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787381619.224115:0:14169:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f561500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:14169:1874205065975296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787381619.224732:0:16232:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787381619.224776:0:14169:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787381619.224788:0:14169:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787381619.224796:0:14169:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1e00/0xbdc38ada7ea10d89 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10d90 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381619.224810:0:14169:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9a1647eb1e00/0xbdc38ada7ea10d89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xbdc38ada7ea10d90 expref: -99 pid: 14169 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381619.595797:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381619.595877:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047111040 00000100:00100000:2.0:1787381619.595886:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047111040 00000100:00100000:2.0:1787381619.595935:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 114 00000100:00100000:2.0:1787381619.595943:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16799ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a658e7c5-3f7d-4d71-838f-01592bc16d6a+11:13708:x1874205047111040:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787381619.595970:0:14166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381619.595986:0:14166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a16413a1800/0xbdc38ada7ea10d97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc01952459a953b79 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381619.596049:0:14166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a16413a1800/0xbdc38ada7ea10d97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953b79 expref: 12 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381619.596061:0:14166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a16413a1800/0xbdc38ada7ea10d97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953b79 expref: 12 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381619.596070:0:14166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16413a1800, rc 0) 00000100:00100000:2.0:1787381619.596128:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16799ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a658e7c5-3f7d-4d71-838f-01592bc16d6a+12:13708:x1874205047111040:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 Request processed in 185us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381619.596135:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 114 00000100:00100000:0.0:1787381619.598079:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381619.598175:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047111168 00000100:00100000:2.0:1787381619.598184:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047111168 00000100:00100000:2.0:1787381619.598234:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 115 00000100:00100000:2.0:1787381619.598243:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16799c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a658e7c5-3f7d-4d71-838f-01592bc16d6a+12:13708:x1874205047111168:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787381619.598523:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16799c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a658e7c5-3f7d-4d71-838f-01592bc16d6a+12:13708:x1874205047111168:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 Request processed in 280us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381619.598531:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 115 00000100:00100000:0.0:1787381619.602622:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381619.602756:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047111296 00000100:00100000:3.0:1787381619.602766:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047111296 00000100:00100000:3.0:1787381619.602821:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 116 00000100:00100000:3.0:1787381619.602831:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16799c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a658e7c5-3f7d-4d71-838f-01592bc16d6a+12:13708:x1874205047111296:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787381619.603081:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16799c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a658e7c5-3f7d-4d71-838f-01592bc16d6a+12:13708:x1874205047111296:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 Request processed in 251us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381619.603089:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 116 00000100:00100000:0.0:1787381619.634381:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381619.639788:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047111424 00000100:00100000:2.0:1787381619.639802:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047111424 00000100:00100000:2.0:1787381619.639932:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 117 00000100:00100000:2.0:1787381619.639943:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16799c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a658e7c5-3f7d-4d71-838f-01592bc16d6a+12:13708:x1874205047111424:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787381619.639958:0:14166:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381619.639985:0:14166:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a16413a1200/0xbdc38ada7ea10d9e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc01952459a953b80 expref: -99 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381619.640027:0:14166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a16413a1200/0xbdc38ada7ea10d9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953b80 expref: 13 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381619.640040:0:14166:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a16413a1200/0xbdc38ada7ea10d9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953b80 expref: 13 pid: 14166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381619.640049:0:14166:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a16413a1200, rc 0) 00000100:00100000:2.0:1787381619.640181:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16799c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a658e7c5-3f7d-4d71-838f-01592bc16d6a+13:13708:x1874205047111424:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 Request processed in 239us (5809us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381619.640196:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 117 00000100:00100000:1.0:1787381619.646846:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381619.650346:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047111552 00000100:00100000:0.0:1787381619.650364:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047111552 00000100:00100000:0.0:1787381619.650432:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 118 00000100:00100000:0.0:1787381619.650441:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16799cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a658e7c5-3f7d-4d71-838f-01592bc16d6a+13:13708:x1874205047111552:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787381619.650743:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16799cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a658e7c5-3f7d-4d71-838f-01592bc16d6a+13:13708:x1874205047111552:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 Request processed in 301us (3905us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381619.650759:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 118 00000100:00100000:0.0:1787381619.654385:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381619.654524:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047111680 00000100:00100000:2.0:1787381619.654535:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047111680 00000100:00100000:2.0:1787381619.654584:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 119 00000100:00100000:2.0:1787381619.654594:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16799cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a658e7c5-3f7d-4d71-838f-01592bc16d6a+13:13708:x1874205047111680:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787381619.654806:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16799cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a658e7c5-3f7d-4d71-838f-01592bc16d6a+13:13708:x1874205047111680:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 Request processed in 212us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381619.654814:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 119 00010000:00010000:3.0:1787381620.044115:0:15541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787381621.068111:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787381621.387870:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381621.387915:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381621.387959:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047111808 00000100:00100000:2.0:1787381621.387971:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047111808 00000100:00100000:2.0:1787381621.388203:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 120 00000100:00100000:2.0:1787381621.388214:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16799c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a658e7c5-3f7d-4d71-838f-01592bc16d6a+13:2349:x1874205047111808:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381621.388745:0:14807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047112064 00000100:00100000:3.0:1787381621.388751:0:14807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047112064 00000100:00100000:3.0:1787381621.388806:0:14807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:3.0:1787381621.388815:0:14807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+5:2349:x1874205047112064:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787381621.388886:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381621.388912:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381621.388958:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381621.388988:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381621.389038:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047112320 00000100:00100000:1.0:1787381621.389042:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047112320 00000100:00100000:1.0:1787381621.389072:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047111936 00000100:00100000:1.0:1787381621.389075:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047111936 00000100:00100000:1.0:1787381621.389097:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:1.0:1787381621.389105:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+6:2349:x1874205047112320:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787381621.389186:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+6:2349:x1874205047112320:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 81us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381621.389194:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:1.0:1787381621.389226:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 24 00000100:00100000:1.0:1787381621.389232:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+6:2349:x1874205047111936:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787381621.389261:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+6:2349:x1874205047111936:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 29us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381621.389268:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 24 00000100:00100000:1.0:1787381621.389288:0:14805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047112576 00000100:00100000:1.0:1787381621.389291:0:14805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047112576 00000100:00100000:1.0:1787381621.389867:0:14805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047112192 00000100:00100000:1.0:1787381621.389873:0:14805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047112192 00000100:00100000:1.0:1787381621.389895:0:14805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:1.0:1787381621.389903:0:14805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+5:2349:x1874205047112576:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787381621.389947:0:14805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+5:2349:x1874205047112576:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 45us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381621.389953:0:14805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:1.0:1787381621.389966:0:14805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:1.0:1787381621.389971:0:14805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+5:2349:x1874205047112192:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787381621.389992:0:14805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+5:2349:x1874205047112192:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 21us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381621.389999:0:14805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00080000:0.0:1787381621.391438:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787381621.391446:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787381621.391449:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787381621.393081:0:14807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+5:2349:x1874205047112064:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 4262us (5159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381621.393098:0:14807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:2.0:1787381621.393515:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16799c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a658e7c5-3f7d-4d71-838f-01592bc16d6a+13:2349:x1874205047111808:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 4817us (5168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381621.393526:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 120 00000100:00100000:1.0:1787381621.398958:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381621.399083:0:14805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047112448 00000100:00100000:2.0:1787381621.399093:0:14805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047112448 00000100:00100000:2.0:1787381621.399172:0:14805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:2.0:1787381621.399182:0:14805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+5:2349:x1874205047112448:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787381621.399271:0:14805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+5:2349:x1874205047112448:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 90us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381621.399279:0:14805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00080000:0.0:1787381621.399577:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787381621.580868:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a5c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:3309:1874205065975424:0@lo:400:kworker.0 00000100:00100000:0.0:1787381621.580945:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381621.580991:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a5c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1874205065975936:0@lo:400:kworker.0 00000100:00100000:0.0:1787381621.581040:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381621.581068:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787381621.581074:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a5c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874205065975808:0@lo:400:kworker.0 00000100:00100000:0.0:1787381621.581095:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381621.581120:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a5c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065975552:0@lo:400:kworker.0 00000100:00100000:0.0:1787381621.581162:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787381621.581181:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a5cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1874205065976064:0@lo:400:kworker.0 00000100:00100000:3.0:1787381621.581197:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a5c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065975680:0@lo:400:kworker.0 00000100:00100000:1.0:1787381621.581329:0:14164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065975424 00000100:00100000:1.0:1787381621.581337:0:14164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065975424 00000100:00100000:1.0:1787381621.581383:0:14164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787381621.581402:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381621.581410:0:14164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16799cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+19:3309:x1874205065975424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787381621.581468:0:3311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f563480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065976192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787381621.581476:0:14164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16799cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+19:3309:x1874205065975424:12345-0@lo:400:kworker.0 Request processed in 82us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381621.581498:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381621.581502:0:14164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787381621.581545:0:15953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065975936 00000100:00100000:1.0:1787381621.581549:0:15953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065975936 00000100:00100000:3.0:1787381621.581552:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065976192 00000100:00100000:3.0:1787381621.581557:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065976192 00000100:00100000:1.0:1787381621.581589:0:15953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065975808 00000100:00100000:1.0:1787381621.581594:0:15953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065975808 00000100:00100000:3.0:1787381621.581599:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787381621.581608:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f561f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065976192:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787381621.581625:0:15953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787381621.581634:0:15953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874205065975936:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1787381621.581638:0:14810:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787381621.581676:0:15953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874205065975936:12345-0@lo:400:kworker.0 Request processed in 44us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381621.581684:0:15953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787381621.581689:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f561f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065976192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381621.581697:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787381621.581702:0:15953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787381621.581711:0:15953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874205065975808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787381621.581744:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f563480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065976192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787381621.581751:0:15953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874205065975808:12345-0@lo:400:kworker.0 Request processed in 39us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381621.581760:0:15953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787381621.581770:0:14807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065975552 00000100:00100000:3.0:1787381621.581774:0:14807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065975552 00000100:00100000:1.0:1787381621.581791:0:15543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065975680 00000100:00100000:1.0:1787381621.581797:0:15543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065975680 00000100:00100000:3.0:1787381621.581802:0:14807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787381621.581830:0:15543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787381621.581838:0:15543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f561500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065975680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381621.581872:0:15543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f561500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874205065975680:12345-0@lo:400:kworker.0 Request processed in 35us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381621.581879:0:15543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1787381621.581899:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787381621.581903:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787381621.581906:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787381621.582090:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a5c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874205065975808:0@lo:400:kworker.0 00000100:00100000:1.0:1787381621.582111:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a5c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:3309:1874205065975424:0@lo:400:kworker.0 00000100:00100000:1.0:1787381621.582120:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a5c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1874205065975936:0@lo:400:kworker.0 00000100:00100000:3.0:1787381621.582231:0:14807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065975552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787381621.582267:0:14807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065975552:12345-0@lo:400:kworker.0 Request processed in 458us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381621.582274:0:14807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787381621.582300:0:3311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a5c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1874205065975680:0@lo:400:kworker.0 00000100:00100000:3.0:1787381621.582539:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787381621.582550:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167f59d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065976320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787381621.582578:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381621.582680:0:14810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065976320 00000100:00100000:0.0:1787381621.582685:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381621.582687:0:14810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065976320 00000100:00100000:2.0:1787381621.582716:0:14810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787381621.582724:0:14810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f563480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065976320:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787381621.582735:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a5c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065975552:0@lo:400:kworker.0 00002000:00000024:2.0:1787381621.582746:0:14810:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787381621.582820:0:15953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065976064 00000100:00100000:3.0:1787381621.582824:0:15953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065976064 00000100:00100000:3.0:1787381621.582858:0:15953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787381621.582864:0:15953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874205065976064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787381621.582895:0:15953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874205065976064:12345-0@lo:400:kworker.0 Request processed in 31us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381621.582911:0:15953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1787381621.582926:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787381621.583044:0:14810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f563480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065976320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 320us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381621.583106:0:14810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787381621.584352:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167f59d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065976320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787381621.584552:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a5cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1874205065976064:0@lo:400:kworker.0 00000100:00100000:1.0:1787381621.896688:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381621.896870:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047112704 00000100:00100000:2.0:1787381621.896880:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047112704 00000100:00100000:2.0:1787381621.896967:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:2.0:1787381621.896979:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+6:14364:x1874205047112704:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787381621.896998:0:14173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381621.897047:0:14173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0800/0xbdc38ada7ea10da5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953b87 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381621.897990:0:14173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0600/0xbdc38ada7ea10dac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381621.898100:0:14173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0600/0xbdc38ada7ea10dac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381621.898129:0:14173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0600/0xbdc38ada7ea10dac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381621.898438:0:14173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea10db3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381621.898446:0:14173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea10db3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381621.898453:0:14173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea10db3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381621.898884:0:14173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166b200/0xbdc38ada7ea10dba lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381621.898893:0:14173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166b200/0xbdc38ada7ea10dba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381621.898900:0:14173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166b200/0xbdc38ada7ea10dba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787381621.900449:0:14173:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787381621.900457:0:14173:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787381621.900564:0:14173:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166b200/0xbdc38ada7ea10dba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381621.900579:0:14173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0600/0xbdc38ada7ea10dac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381621.900586:0:14173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0600/0xbdc38ada7ea10dac lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381621.900603:0:14173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0600/0xbdc38ada7ea10dac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381621.900608:0:14173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a0600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381621.900613:0:14173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0600/0xbdc38ada7ea10dac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381621.900621:0:14173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0600/0xbdc38ada7ea10dac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381621.900635:0:14173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a16522d1a00) 00010000:00010000:2.0:1787381621.900637:0:14173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381621.900641:0:14173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0600/0xbdc38ada7ea10dac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381621.900648:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0600/0xbdc38ada7ea10dac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381621.900661:0:14173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea10db3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381621.900667:0:14173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea10db3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381621.900672:0:14173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea10db3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381621.900677:0:14173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a16413a0a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381621.900679:0:14173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea10db3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381621.900998:0:14173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea10db3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381621.901128:0:14173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9a1650b8fa00) 00010000:00010000:2.0:1787381621.901131:0:14173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381621.901134:0:14173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea10db3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381621.901149:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0a00/0xbdc38ada7ea10db3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381621.901193:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a16413a0800/0xbdc38ada7ea10da5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953b87 expref: 8 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381621.901605:0:14173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166b200/0xbdc38ada7ea10dba lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953b87 expref: 7 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381621.901613:0:14173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a1650b8f600) 00010000:00010000:2.0:1787381621.901616:0:14173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787381621.901618:0:14173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a164166b200, rc 0) 00000100:00100000:2.0:1787381621.901708:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+7:14364:x1874205047112704:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 4730us (5029us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381621.901716:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:3.0:1787381621.907436:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381621.907631:0:15953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047112960 00000100:00100000:1.0:1787381621.907642:0:15953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047112960 00000100:00100000:1.0:1787381621.907743:0:15953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:1.0:1787381621.907753:0:15953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f561880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+7:14364:x1874205047112960:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787381621.907776:0:15953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381621.907796:0:15953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea10dc1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953b8e expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381621.907869:0:15953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea10dc8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381621.907883:0:15953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea10dc8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381621.907893:0:15953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea10dc8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381621.907958:0:15953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea10dcf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381621.907966:0:15953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea10dcf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381621.907973:0:15953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea10dcf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381621.908823:0:15953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388400/0xbdc38ada7ea10dd6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381621.908836:0:15953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388400/0xbdc38ada7ea10dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381621.908844:0:15953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388400/0xbdc38ada7ea10dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787381621.908854:0:15953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787381621.909263:0:15953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea10dc8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381621.909272:0:15953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea10dc8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381621.909279:0:15953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea10dc8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381621.909285:0:15953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381621.909290:0:15953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea10dc8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381621.909360:0:15953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea10dc8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381621.909375:0:15953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a1650b8f600) 00010000:00010000:1.0:1787381621.909379:0:15953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381621.909383:0:15953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea10dc8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381621.909401:0:15953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea10dc8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381621.909415:0:15953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea10dcf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381621.909420:0:15953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea10dcf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381621.909425:0:15953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea10dcf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381621.909430:0:15953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541389600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381621.909432:0:15953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea10dcf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381621.909438:0:15953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea10dcf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381621.909446:0:15953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a16522d1800) 00010000:00010000:1.0:1787381621.909449:0:15953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381621.909451:0:15953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea10dcf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381621.909456:0:15953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea10dcf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381621.909852:0:15953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea10dc1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953b8e expref: 10 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381621.909880:0:15953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388400/0xbdc38ada7ea10dd6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953b8e expref: 9 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381621.909887:0:15953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a16522d1700) 00010000:00010000:1.0:1787381621.909889:0:15953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381621.909891:0:15953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541388400, rc 0) 00000100:00100000:1.0:1787381621.910149:0:15953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f561880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+9:14364:x1874205047112960:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 2384us (2708us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787381621.910158:0:15953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:0.0:1787381621.915170:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381621.915697:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047113088 00000100:00100000:1.0:1787381621.915707:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047113088 00000100:00100000:1.0:1787381621.915763:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:1.0:1787381621.915772:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+9:14364:x1874205047113088:12345-192.168.203.22@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787381621.915870:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+9:14364:x1874205047113088:12345-192.168.203.22@tcp:59:lhsmtool_posix.0 Request processed in 99us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381621.915878:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:2.0:1787381621.978182:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381621.978263:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047113216 00000100:00100000:3.0:1787381621.978283:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047113216 00000100:00100000:3.0:1787381621.978357:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:3.0:1787381621.978368:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+9:14370:x1874205047113216:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1787381621.978389:0:14172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381621.978432:0:14172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0e00/0xbdc38ada7ea10de4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953b95 expref: -99 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381621.978494:0:14172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1600/0xbdc38ada7ea10deb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381621.978512:0:14172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1600/0xbdc38ada7ea10deb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381621.978524:0:14172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1600/0xbdc38ada7ea10deb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381621.978539:0:14172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea10df2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381621.978547:0:14172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea10df2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381621.978553:0:14172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea10df2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381621.978823:0:14172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1600/0xbdc38ada7ea10deb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381621.978837:0:14172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1600/0xbdc38ada7ea10deb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381621.978843:0:14172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1600/0xbdc38ada7ea10deb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381621.978849:0:14172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb1600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381621.978853:0:14172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1600/0xbdc38ada7ea10deb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381621.978861:0:14172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1600/0xbdc38ada7ea10deb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381621.978873:0:14172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a16522d1a00) 00010000:00010000:3.0:1787381621.978877:0:14172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381621.978881:0:14172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1600/0xbdc38ada7ea10deb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381621.978887:0:14172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1600/0xbdc38ada7ea10deb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381621.978900:0:14172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea10df2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381621.978906:0:14172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea10df2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381621.978912:0:14172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea10df2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381621.978916:0:14172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb0600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381621.978925:0:14172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea10df2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381621.978932:0:14172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea10df2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381621.978940:0:14172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a1643052700) 00010000:00010000:3.0:1787381621.978943:0:14172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381621.978945:0:14172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea10df2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381621.978951:0:14172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea10df2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381621.978985:0:14172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0e00/0xbdc38ada7ea10de4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953b95 expref: 10 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381621.978995:0:14172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a16522d1a00) 00010000:00010000:3.0:1787381621.978997:0:14172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381621.979001:0:14172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0e00/0xbdc38ada7ea10de4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953b95 expref: 10 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381621.979068:0:14172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb0e00, rc 0) 00000100:00100000:3.0:1787381621.979129:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+9:14370:x1874205047113216:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 762us (956us total) trans 0 rc 301/301 00000100:00100000:3.0:1787381621.979136:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:3.0:1787381621.993573:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381621.994283:0:14180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047113344 00000100:00100000:2.0:1787381621.994513:0:14180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047113344 00000100:00100000:2.0:1787381621.994581:0:14180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:2.0:1787381621.994593:0:14180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f560a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+9:14370:x1874205047113344:12345-192.168.203.22@tcp:700:lfs.0 00000100:00100000:2.0:1787381621.994714:0:14180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f560a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+9:14370:x1874205047113344:12345-192.168.203.22@tcp:700:lfs.0 Request processed in 112us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381621.994724:0:14180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:0.0:1787381622.002089:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381622.003068:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047113600 00000100:00100000:1.0:1787381622.003085:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047113600 00000100:00100000:1.0:1787381622.003198:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:1.0:1787381622.003209:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+9:14370:x1874205047113600:12345-192.168.203.22@tcp:36:lfs.0 00010000:00010000:1.0:1787381622.003282:0:14171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381622.003319:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10d27 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953b10 expref: 9 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.003344:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a16522d1a00) 00010000:00010000:1.0:1787381622.003363:0:14171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787381622.003671:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea10df9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.003686:0:14171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea10d5f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953b72 expref: 5 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.003695:0:14171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea10df9 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.003729:0:14171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea10d5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953b72 expref: 5 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.003743:0:14171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea10d5f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953b72 expref: 5 pid: 14172 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381622.003757:0:14171:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14171:1874205065976448:192.168.203.22@tcp:104: 00000100:00100000:1.0:1787381622.003889:0:14171:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a166d06f900 going to sleep for 11 seconds 00000100:00100000:2.0:1787381622.009036:0:14171:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14171:1874205065976448:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787381622.009067:0:14171:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea10df9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381622.009813:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381622.009879:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047113728 00000100:00100000:1.0:1787381622.009887:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047113728 00010000:00010000:1.0:1787381622.009926:0:14156:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea10d5f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953b72 expref: 6 pid: 14172 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381622.009970:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:1.0:1787381622.009979:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+6:2349:x1874205047113728:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787381622.009994:0:14156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381622.010001:0:14156:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea10d5f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953b72 expref: 6 pid: 14172 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.010063:0:14156:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea10d5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953b72 expref: 6 pid: 14172 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.010085:0:14156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea10d5f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953b72 expref: 6 pid: 14172 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.010100:0:14156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a16522d1a00) 00010000:00010000:1.0:1787381622.010105:0:14156:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea10df9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.010126:0:14156:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea10df9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.010133:0:14156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea10df9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.010172:0:14156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381622.010237:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+5:2349:x1874205047113728:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 259us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381622.010246:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 9 00010000:00010000:3.0:1787381622.010493:0:14171:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea10df9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381622.010511:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea10df9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381622.010534:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0e00/0xbdc38ada7ea10e00 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381622.010543:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0e00/0xbdc38ada7ea10e00 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381622.010551:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0e00/0xbdc38ada7ea10e00 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787381622.018891:0:14171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787381622.018911:0:14171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea10df9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381622.018922:0:14171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea10df9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381622.018930:0:14171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea10df9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381622.018936:0:14171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541389600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381622.018941:0:14171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea10df9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381622.018948:0:14171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea10df9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381622.018965:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a16522d1a00) 00010000:00010000:3.0:1787381622.018968:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381622.018980:0:14171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea10df9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381622.018986:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea10df9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787381622.019049:0:14171:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e2d83af8 reply state 00000000343a2ebe transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0e00/0xbdc38ada7ea10e00 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381622.019059:0:14171:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787381622.019209:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+10:14370:x1874205047113600:12345-192.168.203.22@tcp:36:lfs.0 Request processed in 15996us (17122us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787381622.019219:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 19 00010000:00010000:2.0:1787381622.023104:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0e00/0xbdc38ada7ea10e00 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381622.023125:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0e00/0xbdc38ada7ea10e00 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381622.023133:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0e00/0xbdc38ada7ea10e00 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381622.023152:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb0e00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381622.023157:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0e00/0xbdc38ada7ea10e00 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381622.023163:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0e00/0xbdc38ada7ea10e00 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381622.023181:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a1643052700) 00010000:00010000:2.0:1787381622.023185:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381622.023190:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0e00/0xbdc38ada7ea10e00 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381622.023196:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0e00/0xbdc38ada7ea10e00 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.093559:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787381622.124928:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381622.125885:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047113856 00000100:00100000:3.0:1787381622.125899:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047113856 00000100:00100000:3.0:1787381622.126040:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:3.0:1787381622.126052:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+9:14378:x1874205047113856:12345-192.168.203.22@tcp:101:lctl.0 00010000:00010000:3.0:1787381622.126080:0:14172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381622.126103:0:14172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea10e07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953b9c expref: -99 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381622.126183:0:14172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1600/0xbdc38ada7ea10e0e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381622.126211:0:14172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1600/0xbdc38ada7ea10e0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381622.126225:0:14172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1600/0xbdc38ada7ea10e0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787381622.126286:0:14172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787381622.126311:0:14172:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1787381622.126356:0:14172:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1600/0xbdc38ada7ea10e0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381622.126382:0:14172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea10e07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953b9c expref: 11 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381622.126403:0:14172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1600/0xbdc38ada7ea10e0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953b9c expref: 10 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381622.126412:0:14172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1643052900) 00010000:00010000:3.0:1787381622.126415:0:14172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787381622.126418:0:14172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb1600, rc 0) 00000100:00100000:3.0:1787381622.126493:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+10:14378:x1874205047113856:12345-192.168.203.22@tcp:101:lctl.0 Request processed in 444us (1575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381622.126501:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:0.0:1787381622.153500:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381622.153596:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047113984 00000100:00100000:2.0:1787381622.153608:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047113984 00000100:00100000:2.0:1787381622.153668:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:2.0:1787381622.153678:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+5:14379:x1874205047113984:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1787381622.153699:0:14173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381622.153718:0:14173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166ae00/0xbdc38ada7ea10e15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953ba3 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381622.153783:0:14173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166bc00/0xbdc38ada7ea10e1c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381622.153798:0:14173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166bc00/0xbdc38ada7ea10e1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381622.153810:0:14173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166bc00/0xbdc38ada7ea10e1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787381622.153871:0:14173:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787381622.153875:0:14173:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1787381622.153902:0:14173:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166bc00/0xbdc38ada7ea10e1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381622.153926:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166ae00/0xbdc38ada7ea10e15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953ba3 expref: 7 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381622.153945:0:14173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166bc00/0xbdc38ada7ea10e1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953ba3 expref: 6 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381622.153953:0:14173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1643052900) 00010000:00010000:2.0:1787381622.153968:0:14173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787381622.153972:0:14173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a164166bc00, rc 0) 00000100:00100000:2.0:1787381622.154152:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+6:14379:x1874205047113984:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 474us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381622.154161:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:2.0:1787381622.156844:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381622.156919:0:15953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047114112 00000100:00100000:1.0:1787381622.156928:0:15953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047114112 00000100:00100000:1.0:1787381622.156985:0:15953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:1.0:1787381622.156994:0:15953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+6:14379:x1874205047114112:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1787381622.157040:0:15953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381622.157060:0:15953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea10e23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953baa expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.157161:0:15953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea10e2a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.157176:0:15953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea10e2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.157189:0:15953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea10e2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.157203:0:15953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10e31 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.157210:0:15953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10e31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.157216:0:15953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10e31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.157850:0:15953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389400/0xbdc38ada7ea10e38 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.157863:0:15953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389400/0xbdc38ada7ea10e38 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.157871:0:15953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389400/0xbdc38ada7ea10e38 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787381622.157913:0:15953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787381622.157917:0:15953:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787381622.157943:0:15953:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389400/0xbdc38ada7ea10e38 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.157969:0:15953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea10e2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.157976:0:15953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea10e2a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.157983:0:15953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea10e2a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.157990:0:15953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388c00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381622.157995:0:15953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea10e2a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.158033:0:15953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea10e2a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.158047:0:15953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1643052900) 00010000:00010000:1.0:1787381622.158050:0:15953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381622.158054:0:15953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea10e2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.158061:0:15953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea10e2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.158074:0:15953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10e31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.158080:0:15953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10e31 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.158085:0:15953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10e31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.158098:0:15953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381622.158101:0:15953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10e31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.158106:0:15953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10e31 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.158115:0:15953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a16522d1800) 00010000:00010000:1.0:1787381622.158117:0:15953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381622.158120:0:15953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10e31 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.158126:0:15953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10e31 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.158173:0:15953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea10e23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953baa expref: 8 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.158185:0:15953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389400/0xbdc38ada7ea10e38 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953baa expref: 7 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.158191:0:15953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a16522d1b00) 00010000:00010000:1.0:1787381622.158193:0:15953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787381622.158196:0:15953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541389400, rc 0) 00000100:00100000:1.0:1787381622.158275:0:15953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+7:14379:x1874205047114112:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 1281us (1440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381622.158283:0:15953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:3.0:1787381622.165400:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381622.165617:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047114368 00000100:00100000:2.0:1787381622.165626:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047114368 00000100:00100000:2.0:1787381622.165691:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:2.0:1787381622.165701:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+7:14379:x1874205047114368:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1787381622.165722:0:14171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381622.165741:0:14171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166ae00/0xbdc38ada7ea10e3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953bb1 expref: -99 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787381622.165857:0:14171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787381622.165970:0:14171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166ae00/0xbdc38ada7ea10e3f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953bb1 expref: 9 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381622.165984:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1643052900) 00010000:00010000:2.0:1787381622.165987:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787381622.165991:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166ae00/0xbdc38ada7ea10e3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953bb1 expref: 9 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381622.166028:0:14171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a164166ae00, rc 0) 00000100:00100000:2.0:1787381622.166090:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f560700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+8:14379:x1874205047114368:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 390us (700us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1787381622.166097:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:0.0:1787381622.168677:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381622.168815:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047114624 00000100:00100000:3.0:1787381622.168824:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047114624 00000100:00100000:3.0:1787381622.168886:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 24 00000100:00100000:3.0:1787381622.168895:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+8:14379:x1874205047114624:12345-192.168.203.22@tcp:36:lfs.0 00010000:00010000:3.0:1787381622.168948:0:14172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787381622.168973:0:14172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389400/0xbdc38ada7ea10e38 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953baa expref: 8 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381622.168990:0:14172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a16522d1b00) 00010000:00010000:3.0:1787381622.169001:0:14172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787381622.169058:0:14172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea10e4d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381622.169083:0:14172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea10e4d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381622.169094:0:14172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea10e4d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787381622.169710:0:14172:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000db00ffe7 reply state 00000000912087f6 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea10e4d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381622.169721:0:14172:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787381622.169737:0:14172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:3.0:1787381622.169826:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+9:14379:x1874205047114624:12345-192.168.203.22@tcp:36:lfs.0 Request processed in 930us (1157us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787381622.169834:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 24 00010000:00010000:1.0:1787381622.171486:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea10e4d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.171512:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea10e4d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.171520:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea10e4d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.171526:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb0600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381622.171531:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea10e4d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.171538:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea10e4d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.171553:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a1643052200) 00010000:00010000:1.0:1787381622.171555:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1787381622.171560:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea10e4d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.171565:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea10e4d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381622.172048:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381622.172223:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047114880 00000100:00100000:1.0:1787381622.172232:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047114880 00000100:00100000:1.0:1787381622.172293:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:1.0:1787381622.172313:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+8:14379:x1874205047114880:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:1.0:1787381622.172743:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+9:14379:x1874205047114880:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 431us (698us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1787381622.172753:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:3.0:1787381622.178448:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381622.178626:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047115136 00000100:00100000:2.0:1787381622.178635:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047115136 00000100:00100000:2.0:1787381622.178693:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:2.0:1787381622.178703:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f563800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+9:14379:x1874205047115136:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1787381622.178726:0:14171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381622.178744:0:14171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166ae00/0xbdc38ada7ea10e54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953bb8 expref: -99 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381622.178825:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166b400/0xbdc38ada7ea10e5b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381622.178840:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166b400/0xbdc38ada7ea10e5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381622.178851:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166b400/0xbdc38ada7ea10e5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381622.178867:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166b000/0xbdc38ada7ea10e62 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381622.178874:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166b000/0xbdc38ada7ea10e62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381622.178881:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166b000/0xbdc38ada7ea10e62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787381622.179041:0:14171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787381622.179153:0:14171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166b400/0xbdc38ada7ea10e5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381622.179161:0:14171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166b400/0xbdc38ada7ea10e5b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381622.179186:0:14171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166b400/0xbdc38ada7ea10e5b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381622.179192:0:14171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a164166b400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381622.179196:0:14171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166b400/0xbdc38ada7ea10e5b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381622.179204:0:14171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166b400/0xbdc38ada7ea10e5b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381622.179217:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1643052900) 00010000:00010000:2.0:1787381622.179220:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381622.179225:0:14171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166b400/0xbdc38ada7ea10e5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381622.179231:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166b400/0xbdc38ada7ea10e5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381622.179245:0:14171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166b000/0xbdc38ada7ea10e62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381622.179251:0:14171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166b000/0xbdc38ada7ea10e62 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381622.179257:0:14171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166b000/0xbdc38ada7ea10e62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381622.179262:0:14171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a164166b000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381622.179265:0:14171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166b000/0xbdc38ada7ea10e62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381622.179280:0:14171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166b000/0xbdc38ada7ea10e62 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381622.179288:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a1650b8fa00) 00010000:00010000:2.0:1787381622.179290:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381622.179293:0:14171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166b000/0xbdc38ada7ea10e62 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381622.179530:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166b000/0xbdc38ada7ea10e62 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381622.179572:0:14171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166ae00/0xbdc38ada7ea10e54 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953bb8 expref: 11 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381622.179584:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1643052900) 00010000:00010000:2.0:1787381622.179586:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787381622.179590:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166ae00/0xbdc38ada7ea10e54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953bb8 expref: 11 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381622.179602:0:14171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a164166ae00, rc 0) 00000100:00100000:2.0:1787381622.179669:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f563800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+10:14379:x1874205047115136:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 967us (1230us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1787381622.179678:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:0.0:1787381622.182885:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381622.184703:0:15953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047115264 00000100:00100000:1.0:1787381622.184730:0:15953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047115264 00000100:00100000:1.0:1787381622.184801:0:15953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 26 00000100:00100000:1.0:1787381622.184812:0:15953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+10:14379:x1874205047115264:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1787381622.184837:0:15953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381622.184859:0:15953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea10e70 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953bbf expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.184946:0:15953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10e77 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.184960:0:15953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10e77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.184972:0:15953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10e77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787381622.185055:0:15953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787381622.185059:0:15953:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787381622.185082:0:15953:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10e77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.185113:0:15953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea10e70 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953bbf expref: 12 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.185130:0:15953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10e77 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953bbf expref: 11 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.185148:0:15953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a16522d1800) 00010000:00010000:1.0:1787381622.185152:0:15953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787381622.185155:0:15953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541388800, rc 0) 00000100:00100000:0.0:1787381622.185303:0:15953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+11:14379:x1874205047115264:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 491us (2427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381622.185311:0:15953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 26 00000100:00100000:0.0:1787381622.191544:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381622.191766:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047115392 00000100:00100000:3.0:1787381622.191778:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047115392 00000100:00100000:3.0:1787381622.191835:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 3 00000100:00100000:3.0:1787381622.191845:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+11:14379:x1874205047115392:12345-192.168.203.22@tcp:37:lfs.0 00000100:00100000:0.0:1787381622.198207:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+11:14379:x1874205047115392:12345-192.168.203.22@tcp:37:lfs.0 Request processed in 6351us (6661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381622.198221:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 3 00000100:00100000:0.0:1787381622.203823:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381622.203906:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047115648 00000100:00100000:1.0:1787381622.203915:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047115648 00000100:00100000:1.0:1787381622.203970:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:1.0:1787381622.203980:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f69e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+11:14379:x1874205047115648:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:1.0:1787381622.204266:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f69e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+12:14379:x1874205047115648:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 286us (451us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1787381622.204275:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:2.0:1787381622.264562:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381622.268625:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047115776 00000100:00100000:1.0:1787381622.268641:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047115776 00000100:00100000:1.0:1787381622.268713:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 27 00000100:00100000:1.0:1787381622.268723:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+10:14385:x1874205047115776:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:1.0:1787381622.268743:0:14173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381622.268761:0:14173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea10e7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953bc6 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.268821:0:14173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea10e85 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.268834:0:14173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea10e85 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.268844:0:14173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea10e85 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.268859:0:14173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389400/0xbdc38ada7ea10e8c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.268865:0:14173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389400/0xbdc38ada7ea10e8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.268891:0:14173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389400/0xbdc38ada7ea10e8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.269707:0:14173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea10e93 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.269719:0:14173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea10e93 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.269728:0:14173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea10e93 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787381622.270394:0:14173:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787381622.270402:0:14173:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787381622.270460:0:14173:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea10e93 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.270476:0:14173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea10e85 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.270482:0:14173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea10e85 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.270489:0:14173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea10e85 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.270495:0:14173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388c00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381622.270499:0:14173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea10e85 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.270506:0:14173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea10e85 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.270532:0:14173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1643052900) 00010000:00010000:1.0:1787381622.270535:0:14173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381622.270539:0:14173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea10e85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.270545:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea10e85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.270560:0:14173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389400/0xbdc38ada7ea10e8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.270567:0:14173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389400/0xbdc38ada7ea10e8c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.270572:0:14173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389400/0xbdc38ada7ea10e8c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.270577:0:14173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541389400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381622.270580:0:14173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389400/0xbdc38ada7ea10e8c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.270586:0:14173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389400/0xbdc38ada7ea10e8c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.270594:0:14173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9a16522d1d00) 00010000:00010000:1.0:1787381622.270596:0:14173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381622.270599:0:14173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389400/0xbdc38ada7ea10e8c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.270604:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389400/0xbdc38ada7ea10e8c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.270656:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea10e7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953bc6 expref: 12 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.270672:0:14173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389600/0xbdc38ada7ea10e93 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953bc6 expref: 11 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.270679:0:14173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a16522d1800) 00010000:00010000:1.0:1787381622.270681:0:14173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787381622.270684:0:14173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541389600, rc 0) 00000100:00100000:1.0:1787381622.270816:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+11:14385:x1874205047115776:12345-192.168.203.22@tcp:101:bash.0 Request processed in 2093us (6263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381622.270825:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 27 00000100:00100000:3.0:1787381622.274763:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381622.274890:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047116032 00000100:00100000:1.0:1787381622.274900:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047116032 00000100:00100000:1.0:1787381622.274971:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 28 00000100:00100000:1.0:1787381622.274980:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f562300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+11:14385:x1874205047116032:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:1.0:1787381622.274998:0:14172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381622.275044:0:14172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10e9a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953bcd expref: -99 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.275185:0:14172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea10ea1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.275200:0:14172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10e77 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953bbf expref: 11 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.275209:0:14172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea10ea1 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.275251:0:14172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10e77 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953bbf expref: 11 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.275264:0:14172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10e77 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953bbf expref: 11 pid: 15953 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381622.275277:0:14172:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a6f5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14172:1874205065976576:192.168.203.22@tcp:104: 00000100:00100000:1.0:1787381622.275611:0:14172:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a166d06f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787381622.279789:0:14172:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a6f5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14172:1874205065976576:192.168.203.22@tcp:104: 00000100:00100000:3.0:1787381622.280228:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381622.280402:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047116160 00000100:00100000:0.0:1787381622.280410:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047116160 00010000:00010000:0.0:1787381622.280460:0:14157:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10e77 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953bbf expref: 12 pid: 15953 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.280594:0:14172:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea10ea1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381622.280910:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:0.0:1787381622.280922:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f560000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+12:2349:x1874205047116160:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787381622.280937:0:14157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787381622.280944:0:14157:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10e77 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953bbf expref: 12 pid: 15953 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.280957:0:14157:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10e77 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953bbf expref: 12 pid: 15953 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.280981:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10e77 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953bbf expref: 12 pid: 15953 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.281046:0:14157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a16522d1800) 00010000:00010000:0.0:1787381622.281052:0:14157:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea10ea1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.281061:0:14157:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea10ea1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.281069:0:14157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea10ea1 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.281175:0:14157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787381622.281215:0:14172:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea10ea1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.281223:0:14172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea10ea1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.281246:0:14172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea10ea8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.281256:0:14172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea10ea8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.281264:0:14172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea10ea8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381622.281346:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f560000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+11:2349:x1874205047116160:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 425us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381622.281354:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 10 00010000:00010000:1.0:1787381622.282490:0:14172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389400/0xbdc38ada7ea10eaf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.282511:0:14172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389400/0xbdc38ada7ea10eaf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.282519:0:14172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389400/0xbdc38ada7ea10eaf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787381622.282531:0:14172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787381622.282557:0:14172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea10ea1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.282563:0:14172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea10ea1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.282623:0:14172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea10ea1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.282629:0:14172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541389c00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381622.282634:0:14172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea10ea1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.282641:0:14172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea10ea1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.282651:0:14172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a16522d1800) 00010000:00010000:1.0:1787381622.282654:0:14172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381622.282658:0:14172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea10ea1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.282663:0:14172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389c00/0xbdc38ada7ea10ea1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787381622.282675:0:14172:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001d9357d1 reply state 00000000af2614e2 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea10ea8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381622.282689:0:14172:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787381622.282723:0:14172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10e9a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953bcd expref: 14 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.282736:0:14172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389400/0xbdc38ada7ea10eaf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953bcd expref: 13 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.282743:0:14172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a16522d1000) 00010000:00010000:1.0:1787381622.282745:0:14172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1787381622.282747:0:14172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541389400, rc 0) 00000100:00100000:1.0:1787381622.283193:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f562300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+14:14385:x1874205047116032:12345-192.168.203.22@tcp:101:bash.0 Request processed in 8211us (8437us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787381622.283202:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 28 00010000:00010000:1.0:1787381622.286489:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea10ea8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.286506:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea10ea8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.286513:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea10ea8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.286518:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381622.286522:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea10ea8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.286529:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea10ea8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.286561:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9a16522d1d00) 00010000:00010000:1.0:1787381622.286564:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381622.286569:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea10ea8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.286587:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea10ea8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381622.309122:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381622.309232:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047116288 00000100:00100000:0.0:1787381622.309242:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047116288 00000100:00100000:0.0:1787381622.309304:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 29 00000100:00100000:0.0:1787381622.309315:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f561c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+13:14385:x1874205047116288:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:0.0:1787381622.309340:0:14171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381622.309363:0:14171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9800/0xbdc38ada7ea10ebd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953bd4 expref: -99 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.309432:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8c00/0xbdc38ada7ea10ec4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.309446:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8c00/0xbdc38ada7ea10ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.309473:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8c00/0xbdc38ada7ea10ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787381622.309514:0:14171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787381622.309518:0:14171:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787381622.309539:0:14171:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8c00/0xbdc38ada7ea10ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.309550:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8c00/0xbdc38ada7ea10ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.309575:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9800/0xbdc38ada7ea10ebd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953bd4 expref: 15 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.309592:0:14171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8c00/0xbdc38ada7ea10ec4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953bd4 expref: 14 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.309601:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a16522d1000) 00010000:00010000:0.0:1787381622.309603:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787381622.309606:0:14171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1645bc8c00, rc 0) 00000100:00100000:0.0:1787381622.309667:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f561c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+14:14385:x1874205047116288:12345-192.168.203.22@tcp:101:bash.0 Request processed in 353us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381622.309674:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 29 00000100:00100000:3.0:1787381622.320632:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381622.320699:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047116544 00000100:00100000:1.0:1787381622.320709:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047116544 00000100:00100000:1.0:1787381622.320775:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:1.0:1787381622.320786:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f562a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+14:14385:x1874205047116544:12345-192.168.203.22@tcp:35:bash.0 00000100:00100000:1.0:1787381622.321203:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f562a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+15:14385:x1874205047116544:12345-192.168.203.22@tcp:35:bash.0 Request processed in 417us (580us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1787381622.321220:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:3.0:1787381622.459368:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381622.459474:0:15953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047116800 00000100:00100000:0.0:1787381622.459484:0:15953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047116800 00000100:00100000:0.0:1787381622.459552:0:15953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 30 00000100:00100000:0.0:1787381622.459562:0:15953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f562680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+15:14395:x1874205047116800:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1787381622.459588:0:15953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381622.459620:0:15953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9800/0xbdc38ada7ea10ecb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953bdb expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787381622.459734:0:15953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787381622.459854:0:15953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9800/0xbdc38ada7ea10ecb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953bdb expref: 17 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.459869:0:15953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a1643052900) 00010000:00010000:0.0:1787381622.459872:0:15953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787381622.459877:0:15953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9800/0xbdc38ada7ea10ecb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953bdb expref: 17 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.459891:0:15953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1645bc9800, rc 0) 00000100:00100000:0.0:1787381622.459955:0:15953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f562680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+16:14395:x1874205047116800:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 393us (600us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1787381622.459963:0:15953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 30 00000100:00100000:3.0:1787381622.463949:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381622.464124:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047117056 00000100:00100000:1.0:1787381622.464196:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047117056 00000100:00100000:1.0:1787381622.464289:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:1.0:1787381622.464300:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+16:14395:x1874205047117056:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:1.0:1787381622.464562:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f563b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+17:14395:x1874205047117056:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 264us (621us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1787381622.464571:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:3.0:1787381622.517316:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381622.518475:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047117312 00000100:00100000:0.0:1787381622.518488:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047117312 00000100:00100000:0.0:1787381622.518556:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 31 00000100:00100000:0.0:1787381622.518566:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f563100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+17:14398:x1874205047117312:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1787381622.518869:0:14171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381622.518892:0:14171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9800/0xbdc38ada7ea10ed9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953be2 expref: -99 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.519032:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9000/0xbdc38ada7ea10ee0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.519048:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9000/0xbdc38ada7ea10ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.519075:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9000/0xbdc38ada7ea10ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787381622.519089:0:14171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787381622.519404:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9800/0xbdc38ada7ea10ed9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953be2 expref: 20 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.520533:0:14171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9000/0xbdc38ada7ea10ee0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953be2 expref: 19 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.520556:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a16522d1000) 00010000:00010000:0.0:1787381622.520559:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787381622.520563:0:14171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1645bc9000, rc 0) 00000100:00100000:0.0:1787381622.520651:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f563100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+19:14398:x1874205047117312:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 2085us (3343us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787381622.521806:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 31 00000100:00100000:3.0:1787381622.539161:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381622.539207:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381622.539319:0:15953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047117440 00000100:00100000:0.0:1787381622.539329:0:15953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047117440 00000100:00100000:0.0:1787381622.539386:0:15953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 32 00000100:00100000:0.0:1787381622.539395:0:15953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+19:14398:x1874205047117440:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:0.0:1787381622.539460:0:15953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9800/0xbdc38ada7ea10eee lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.539478:0:15953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9800/0xbdc38ada7ea10eee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.539490:0:15953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9800/0xbdc38ada7ea10eee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.539530:0:15953:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9800/0xbdc38ada7ea10eee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.539537:0:15953:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9800/0xbdc38ada7ea10eee lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.539557:0:15953:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9800/0xbdc38ada7ea10eee lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.539563:0:15953:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1645bc9800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787381622.539568:0:15953:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9800/0xbdc38ada7ea10eee lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.539575:0:15953:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9800/0xbdc38ada7ea10eee lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.539588:0:15953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a16522d1000) 00010000:00010000:0.0:1787381622.539591:0:15953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787381622.539605:0:15953:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9800/0xbdc38ada7ea10eee lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.539611:0:15953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9800/0xbdc38ada7ea10eee lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381622.539700:0:15953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f562d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+19:14398:x1874205047117440:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 305us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381622.539709:0:15953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 32 00000100:00100000:1.0:1787381622.540415:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047117568 00000100:00100000:1.0:1787381622.540423:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047117568 00000100:00100000:1.0:1787381622.540473:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:1.0:1787381622.540482:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f560e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+19:2351:x1874205047117568:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787381622.540501:0:14156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381622.540520:0:14156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9000/0xbdc38ada7ea10ee0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953be2 expref: 19 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.540534:0:14156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a16522d1000) 00010000:00010000:1.0:1787381622.540548:0:14156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381622.540583:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f560e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+18:2351:x1874205047117568:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 102us (1375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381622.540600:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 0 00000040:00080000:2.0:1787381622.540636:0:14205:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787381622.557827:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381622.557913:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047117824 00000100:00100000:0.0:1787381622.557923:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047117824 00000100:00100000:0.0:1787381622.557980:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:0.0:1787381622.558043:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+18:14398:x1874205047117824:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:0.0:1787381622.558279:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+19:14398:x1874205047117824:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 277us (461us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1787381622.558288:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:3.0:1787381622.841047:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381622.841830:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047118080 00000100:00100000:1.0:1787381622.841842:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047118080 00000100:00100000:1.0:1787381622.841917:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 33 00000100:00100000:1.0:1787381622.841928:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+19:14429:x1874205047118080:12345-192.168.203.22@tcp:101:cat.0 00010000:00010000:1.0:1787381622.841953:0:14173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787381622.841977:0:14173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea10ef5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953be9 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.842257:0:14173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10efc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.842272:0:14173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10efc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.842285:0:14173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10efc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787381622.842297:0:14173:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787381622.842453:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388a00/0xbdc38ada7ea10ef5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953be9 expref: 22 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.842487:0:14173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10efc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953be9 expref: 21 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.842497:0:14173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a16522d1000) 00010000:00010000:1.0:1787381622.842500:0:14173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787381622.842503:0:14173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1541388600, rc 0) 00000100:00100000:1.0:1787381622.842647:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+21:14429:x1874205047118080:12345-192.168.203.22@tcp:101:cat.0 Request processed in 719us (1650us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1787381622.842655:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 33 00000100:00100000:2.0:1787381622.850089:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381622.850700:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381622.850790:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047118464 00000100:00100000:0.0:1787381622.850811:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047118464 00000100:00100000:0.0:1787381622.850872:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:0.0:1787381622.850883:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+21:14429:x1874205047118464:12345-192.168.203.22@tcp:35:cat.0 00000100:00100000:0.0:1787381622.851272:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+22:14429:x1874205047118464:12345-192.168.203.22@tcp:35:cat.0 Request processed in 390us (572us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1787381622.851280:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:1.0:1787381622.853840:0:16190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047118208 00000100:00100000:1.0:1787381622.853854:0:16190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047118208 00000100:00100000:1.0:1787381622.854256:0:16190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:1.0:1787381622.854271:0:16190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+22:2350:x1874205047118208:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787381622.854288:0:16190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381622.854314:0:16190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10efc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953be9 expref: 22 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.854334:0:16190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a16522d1000) 00010000:00010000:1.0:1787381622.854338:0:16190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381622.854405:0:16190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+21:2350:x1874205047118208:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 137us (4324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381622.861780:0:16190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:3.0:1787381622.927434:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381622.928049:0:15953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047118720 00000100:00100000:0.0:1787381622.928059:0:15953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047118720 00000100:00100000:0.0:1787381622.928117:0:15953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 34 00000100:00100000:0.0:1787381622.928125:0:15953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+21:14435:x1874205047118720:12345-192.168.203.22@tcp:101:dd.0 00010000:00010000:0.0:1787381622.928156:0:15953:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381622.928177:0:15953:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9800/0xbdc38ada7ea10f0a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953bf0 expref: -99 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.928300:0:15953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8e00/0xbdc38ada7ea10f11 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.928316:0:15953:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389400/0xbdc38ada7ea10eaf lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953bcd expref: 22 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.928335:0:15953:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8c00/0xbdc38ada7ea10ec4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953bd4 expref: 22 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.928350:0:15953:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8e00/0xbdc38ada7ea10f11 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.928385:0:15953:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8c00/0xbdc38ada7ea10ec4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953bd4 expref: 22 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.928397:0:15953:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8c00/0xbdc38ada7ea10ec4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953bd4 expref: 22 pid: 14171 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381622.928410:0:15953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a5c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15953:1874205065976704:192.168.203.22@tcp:104: 00010000:00010000:0.0:1787381622.928507:0:15953:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389400/0xbdc38ada7ea10eaf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953bcd expref: 22 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.928515:0:15953:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389400/0xbdc38ada7ea10eaf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953bcd expref: 22 pid: 14172 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381622.928523:0:15953:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a5c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15953:1874205065976832:192.168.203.22@tcp:104: 00000100:00100000:0.0:1787381622.928545:0:15953:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a165827d300 going to sleep for 11 seconds 00000100:00100000:2.0:1787381622.933476:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381622.933515:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381622.933669:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047118976 00000100:00100000:1.0:1787381622.933688:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047118976 00010000:00010000:1.0:1787381622.933725:0:14156:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389400/0xbdc38ada7ea10eaf lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953bcd expref: 23 pid: 14172 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381622.933770:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047118848 00000100:00100000:1.0:1787381622.933774:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047118848 00010000:00010000:1.0:1787381622.933787:0:14156:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8c00/0xbdc38ada7ea10ec4 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953bd4 expref: 24 pid: 14171 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381622.933806:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:1.0:1787381622.933815:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f684050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+24:2350:x1874205047118976:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787381622.933827:0:14156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381622.933833:0:14156:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389400/0xbdc38ada7ea10eaf lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953bcd expref: 24 pid: 14172 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.933844:0:14156:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389400/0xbdc38ada7ea10eaf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953bcd expref: 24 pid: 14172 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.933866:0:14156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a16522d1000) 00010000:00010000:1.0:1787381622.933871:0:14156:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8e00/0xbdc38ada7ea10f11 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.933879:0:14156:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8e00/0xbdc38ada7ea10f11 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.933884:0:14156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381622.933947:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f684050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+24:2350:x1874205047118976:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 132us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381622.933955:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:1.0:1787381622.934000:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:1.0:1787381622.934046:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+23:2351:x1874205047118848:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787381622.934061:0:14156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381622.934067:0:14156:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8c00/0xbdc38ada7ea10ec4 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953bd4 expref: 23 pid: 14171 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.934078:0:14156:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8c00/0xbdc38ada7ea10ec4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953bd4 expref: 23 pid: 14171 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.934089:0:14156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a16522d1000) 00010000:00010000:1.0:1787381622.934093:0:14156:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8e00/0xbdc38ada7ea10f11 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.934100:0:14156:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8e00/0xbdc38ada7ea10f11 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.934107:0:14156:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8e00/0xbdc38ada7ea10f11 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.934123:0:14156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381622.934152:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+23:2351:x1874205047118848:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 108us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381622.934158:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 12 00010000:00010000:0.0:1787381622.934800:0:15953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8c00/0xbdc38ada7ea10ec4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953bd4 expref: 22 pid: 14171 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381622.934819:0:15953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a5c8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15953:1874205065976704:192.168.203.22@tcp:104: 00010000:00010000:0.0:1787381622.934832:0:15953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389400/0xbdc38ada7ea10eaf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953bcd expref: 21 pid: 14172 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381622.934857:0:15953:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a5c8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15953:1874205065976832:192.168.203.22@tcp:104: 00010000:00010000:0.0:1787381622.934882:0:15953:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8e00/0xbdc38ada7ea10f11 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.934890:0:15953:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8e00/0xbdc38ada7ea10f11 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.934896:0:15953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8e00/0xbdc38ada7ea10f11 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787381622.934923:0:15953:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787381622.935153:0:15953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9800/0xbdc38ada7ea10f0a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953bf0 expref: 22 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.935167:0:15953:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8e00/0xbdc38ada7ea10f11 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953bf0 expref: 21 pid: 15953 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.935173:0:15953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a16522d1000) 00010000:00010000:0.0:1787381622.935176:0:15953:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787381622.935179:0:15953:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1645bc8e00, rc 0) 00000100:00100000:0.0:1787381622.935215:0:15953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+21:14435:x1874205047118720:12345-192.168.203.22@tcp:101:dd.0 Request processed in 7091us (7910us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1787381622.935222:0:15953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 34 00000100:00100000:2.0:1787381622.942526:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381622.942626:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047119232 00000100:00100000:1.0:1787381622.942635:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047119232 00000100:00100000:1.0:1787381622.942698:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 35 00000100:00100000:1.0:1787381622.942708:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+21:14435:x1874205047119232:12345-192.168.203.22@tcp:36:dd.0 00010000:00010000:1.0:1787381622.943283:0:14173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea10f1f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.943300:0:14173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea10f1f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381622.943319:0:14173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea10f1f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787381622.943452:0:14173:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1787381622.943489:0:14173:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f18c8fb9 reply state 0000000095a63cdd transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea10f1f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381622.943498:0:14173:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787381622.943597:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+24:14435:x1874205047119232:12345-192.168.203.22@tcp:36:dd.0 Request processed in 889us (1080us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1787381622.943605:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 35 00000020:00080000:1.0:1787381622.943610:0:14173:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787381622.946530:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea10f1f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381622.946549:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea10f1f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381622.946557:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea10f1f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381622.946563:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388c00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:3.0:1787381622.946568:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea10f1f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381622.946576:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea10f1f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381622.946652:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a16522d1000) 00010000:00010000:3.0:1787381622.946655:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787381622.946660:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea10f1f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381622.946666:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388c00/0xbdc38ada7ea10f1f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381622.949606:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381622.949853:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047119360 00000100:00100000:3.0:1787381622.949863:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047119360 00000100:00100000:3.0:1787381622.949919:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 36 00000100:00100000:3.0:1787381622.949927:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f59d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+23:14435:x1874205047119360:12345-192.168.203.22@tcp:101:dd.0 00010000:00010000:3.0:1787381622.949962:0:14172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381622.949981:0:14172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10f26 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953bf7 expref: -99 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381622.950317:0:14172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10f26 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953bf7 expref: 24 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381622.950448:0:14172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10f26 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953bf7 expref: 24 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381622.950472:0:14172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a16522d1000) 00010000:00010000:3.0:1787381622.950475:0:14172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787381622.950478:0:14172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb1200, rc 0) 00000100:00100000:3.0:1787381622.950597:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f59d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+24:14435:x1874205047119360:12345-192.168.203.22@tcp:101:dd.0 Request processed in 669us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381622.950605:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 36 00000100:00100000:1.0:1787381622.977757:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381622.977964:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047119616 00000100:00100000:0.0:1787381622.977974:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047119616 00000100:00100000:0.0:1787381622.978304:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:0.0:1787381622.978315:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+24:14435:x1874205047119616:12345-192.168.203.22@tcp:103:dd.0 00010000:00010000:0.0:1787381622.978418:0:14156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787381622.978443:0:14156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10f26 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953bf7 expref: 24 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.978464:0:14156:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a16522d1000) 00010000:00010000:0.0:1787381622.978470:0:14156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787381622.978531:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+23:14435:x1874205047119616:12345-192.168.203.22@tcp:103:dd.0 Request processed in 218us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381622.978539:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:1.0:1787381622.981772:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381622.981852:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047119744 00000100:00100000:0.0:1787381622.981862:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047119744 00000100:00100000:0.0:1787381622.981917:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 37 00000100:00100000:0.0:1787381622.981926:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+23:14435:x1874205047119744:12345-192.168.203.22@tcp:58:dd.0 00010000:00010000:0.0:1787381622.982867:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9800/0xbdc38ada7ea10f2d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.982887:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9800/0xbdc38ada7ea10f2d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381622.982899:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9800/0xbdc38ada7ea10f2d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787381622.983925:0:14171:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787381622.984116:0:14171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1787381622.984200:0:14171:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1787381622.984326:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f561180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+23:14435:x1874205047119744:12345-192.168.203.22@tcp:58:dd.0 Request processed in 2396us (2557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381622.984337:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 37 00000100:00100000:2.0:1787381622.990468:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381622.993080:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047119872 00000100:00100000:3.0:1787381622.993095:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047119872 00000100:00100000:3.0:1787381622.993459:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 38 00000100:00100000:3.0:1787381622.993470:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a801f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+23:14435:x1874205047119872:12345-192.168.203.22@tcp:101:dd.0 00010000:00010000:3.0:1787381622.993490:0:14172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381622.993510:0:14172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea10f34 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953bfe expref: -99 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381622.993567:0:14172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9800/0xbdc38ada7ea10f2d lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381622.993578:0:14172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea10f34 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953bfe expref: 24 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381622.993615:0:14172:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9800/0xbdc38ada7ea10f2d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381622.993629:0:14172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea10f34 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953bfe expref: 24 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381622.993643:0:14172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a16522d1000) 00010000:00010000:3.0:1787381622.993646:0:14172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787381622.993650:0:14172:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea10f34 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953bfe expref: 24 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381622.993658:0:14172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb1400, rc 0) 00000100:00100000:3.0:1787381622.993794:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a801f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+24:14435:x1874205047119872:12345-192.168.203.22@tcp:101:dd.0 Request processed in 326us (3336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381622.993801:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 38 00010000:00010000:3.0:1787381623.118909:0:15541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787381623.564345:0:14205:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787381623.564354:0:14205:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787381623.564392:0:14205:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787381623.564399:0:14205:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787381623.564520:0:14205:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a802300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14205:1874205065976960:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787381623.564626:0:14205:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167f94a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787381623.570121:0:14205:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a802300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14205:1874205065976960:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787381623.575665:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381623.576203:0:14182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047120000 00000100:00100000:2.0:1787381623.576213:0:14182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047120000 00000100:00080000:3.0:1787381623.576346:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787381623.576531:0:14182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:2.0:1787381623.576542:0:14182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+24:14436:x1874205047120000:12345-192.168.203.22@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787381623.576632:0:14182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f560380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+24:14436:x1874205047120000:12345-192.168.203.22@tcp:900:lhsmtool_posix.0 Request processed in 92us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381623.576640:0:14182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:2.0:1787381623.581841:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381623.581933:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047120128 00000100:00100000:1.0:1787381623.581943:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047120128 00000100:00100000:1.0:1787381623.582001:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00100000:1.0:1787381623.582030:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+24:14436:x1874205047120128:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787381623.582060:0:14173:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787381623.582381:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a801c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+24:14436:x1874205047120128:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 351us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381623.582389:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00100000:3.0:1787381623.586653:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381623.586750:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047120256 00000100:00100000:1.0:1787381623.586760:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047120256 00000100:00100000:1.0:1787381623.586908:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 40 00000100:00100000:1.0:1787381623.586919:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+24:14436:x1874205047120256:12345-192.168.203.22@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787381623.587032:0:14172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10f3b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.587048:0:14172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10f3b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.587060:0:14172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10f3b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.587123:0:14172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10f42 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.587142:0:14172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10f42 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.587149:0:14172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10f42 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.587171:0:14172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389400/0xbdc38ada7ea10f49 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.587179:0:14172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389400/0xbdc38ada7ea10f49 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.587186:0:14172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389400/0xbdc38ada7ea10f49 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787381623.587239:0:14172:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787381623.587244:0:14172:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787381623.587255:0:14172:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389400/0xbdc38ada7ea10f49 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.587266:0:14172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10f3b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.587278:0:14172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10f3b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.587293:0:14172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10f3b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.587300:0:14172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381623.587305:0:14172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10f3b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.587313:0:14172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10f3b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.587324:0:14172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a16522d1700) 00010000:00010000:1.0:1787381623.587327:0:14172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381623.587331:0:14172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10f3b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.587337:0:14172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388800/0xbdc38ada7ea10f3b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.587350:0:14172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10f42 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.587356:0:14172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10f42 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.587362:0:14172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10f42 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.587367:0:14172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388600 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381623.587376:0:14172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10f42 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.587381:0:14172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10f42 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.587389:0:14172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9a16522d1d00) 00010000:00010000:1.0:1787381623.587391:0:14172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381623.587393:0:14172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10f42 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.587398:0:14172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541388600/0xbdc38ada7ea10f42 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.587423:0:14172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389400/0xbdc38ada7ea10f49 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.587428:0:14172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389400/0xbdc38ada7ea10f49 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.587434:0:14172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389400/0xbdc38ada7ea10f49 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.587439:0:14172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541389400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381623.587441:0:14172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389400/0xbdc38ada7ea10f49 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.587446:0:14172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389400/0xbdc38ada7ea10f49 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.587453:0:14172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a16522d1000) 00010000:00010000:1.0:1787381623.587455:0:14172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381623.587463:0:14172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389400/0xbdc38ada7ea10f49 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.587469:0:14172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1541389400/0xbdc38ada7ea10f49 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381623.587543:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+24:14436:x1874205047120256:12345-192.168.203.22@tcp:34:lhsmtool_posix.0 Request processed in 625us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381623.587551:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 40 00000100:00100000:3.0:1787381623.590297:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381623.590359:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047120512 00000100:00100000:0.0:1787381623.590370:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047120512 00000100:00100000:0.0:1787381623.590430:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 41 00000100:00100000:0.0:1787381623.590439:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+24:14436:x1874205047120512:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787381623.590469:0:14171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787381623.590488:0:14171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8c00/0xbdc38ada7ea10f50 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953c05 expref: -99 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.590579:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8000/0xbdc38ada7ea10f57 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.590593:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8000/0xbdc38ada7ea10f57 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.590603:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8000/0xbdc38ada7ea10f57 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787381623.590615:0:14171:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787381623.590713:0:14171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8000/0xbdc38ada7ea10f57 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.590721:0:14171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8000/0xbdc38ada7ea10f57 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.590727:0:14171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8000/0xbdc38ada7ea10f57 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.590733:0:14171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1645bc8000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787381623.590738:0:14171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8000/0xbdc38ada7ea10f57 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.590745:0:14171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8000/0xbdc38ada7ea10f57 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.590772:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a16522d1000) 00010000:00010000:0.0:1787381623.590775:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787381623.590779:0:14171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8000/0xbdc38ada7ea10f57 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.590786:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8000/0xbdc38ada7ea10f57 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.590827:0:14171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8c00/0xbdc38ada7ea10f50 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953c05 expref: 26 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.590838:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a16522d1700) 00010000:00010000:0.0:1787381623.590840:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787381623.590844:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8c00/0xbdc38ada7ea10f50 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953c05 expref: 26 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.590853:0:14171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1645bc8c00, rc 0) 00000100:00100000:0.0:1787381623.590914:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+25:14436:x1874205047120512:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 476us (625us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1787381623.590921:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 41 00000100:00100000:2.0:1787381623.593850:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381623.594215:0:15953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047120640 00000100:00100000:0.0:1787381623.594224:0:15953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047120640 00000100:00100000:0.0:1787381623.594325:0:15953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 42 00000100:00100000:0.0:1787381623.594334:0:15953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a801180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+25:14436:x1874205047120640:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787381623.594365:0:15953:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787381623.594945:0:15953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a801180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+25:14436:x1874205047120640:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 610us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381623.594970:0:15953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 42 00000100:00100000:3.0:1787381623.598198:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381623.599186:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047120896 00000100:00100000:2.0:1787381623.599514:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047120896 00000100:00100000:2.0:1787381623.599613:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 43 00000100:00100000:2.0:1787381623.599623:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+25:14436:x1874205047120896:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787381623.599643:0:14173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787381623.599662:0:14173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166ba00/0xbdc38ada7ea10f65 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953c0c expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787381623.600646:0:14173:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:2.0:1787381623.600661:0:14173:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:2.0:1787381623.600727:0:14173:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1787381623.601197:0:14173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166a000/0xbdc38ada7ea10f6c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.601212:0:14173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166a000/0xbdc38ada7ea10f6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.601224:0:14173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166a000/0xbdc38ada7ea10f6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.601301:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166ba00/0xbdc38ada7ea10f65 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953c0c expref: 28 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.601319:0:14173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166a000/0xbdc38ada7ea10f6c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953c0c expref: 27 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.601328:0:14173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a1650b8fa00) 00010000:00010000:2.0:1787381623.601331:0:14173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787381623.601334:0:14173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a164166a000, rc 0) 00000100:00100000:2.0:1787381623.601402:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+27:14436:x1874205047120896:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 1779us (3212us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1787381623.601422:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 43 00000100:00100000:3.0:1787381623.605959:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381623.606064:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047121152 00000100:00100000:0.0:1787381623.606075:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047121152 00000100:00100000:0.0:1787381623.606125:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 44 00000100:00100000:0.0:1787381623.606144:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+27:14436:x1874205047121152:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787381623.606200:0:14171:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787381623.606225:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166a000/0xbdc38ada7ea10f6c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953c0c expref: 27 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.606246:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a1650b8fa00) 00010000:00010000:0.0:1787381623.606257:0:14171:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787381623.606280:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9200/0xbdc38ada7ea10f7a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.606311:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9200/0xbdc38ada7ea10f7a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.606321:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9200/0xbdc38ada7ea10f7a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.606337:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8a00/0xbdc38ada7ea10f81 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x16de5329 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.606344:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8a00/0xbdc38ada7ea10f81 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x16de5329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.606351:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8a00/0xbdc38ada7ea10f81 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x16de5329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.606445:0:14171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9200/0xbdc38ada7ea10f7a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.606454:0:14171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9200/0xbdc38ada7ea10f7a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.606460:0:14171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9200/0xbdc38ada7ea10f7a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.606467:0:14171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1645bc9200 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787381623.606472:0:14171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9200/0xbdc38ada7ea10f7a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.606480:0:14171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9200/0xbdc38ada7ea10f7a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.606490:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9a16522d1800) 00010000:00010000:0.0:1787381623.606493:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787381623.606497:0:14171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9200/0xbdc38ada7ea10f7a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.606504:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9200/0xbdc38ada7ea10f7a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.606512:0:14171:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8a00/0xbdc38ada7ea10f81 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x16de5329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.606517:0:14171:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8a00/0xbdc38ada7ea10f81 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x16de5329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.606522:0:14171:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8a00/0xbdc38ada7ea10f81 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x16de5329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.606532:0:14171:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1645bc8a00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:0.0:1787381623.606535:0:14171:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8a00/0xbdc38ada7ea10f81 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x16de5329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.606541:0:14171:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8a00/0xbdc38ada7ea10f81 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x16de5329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.606549:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x16de5329 (ffff9a1647d85b00) 00010000:00010000:0.0:1787381623.606551:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787381623.606553:0:14171:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8a00/0xbdc38ada7ea10f81 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x16de5329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.606558:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8a00/0xbdc38ada7ea10f81 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x16de5329 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381623.606640:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+26:14436:x1874205047121152:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 497us (690us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787381623.606648:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 44 00000100:00100000:0.0:1787381623.609607:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381623.609741:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047121280 00000100:00100000:3.0:1787381623.609750:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047121280 00000100:00100000:3.0:1787381623.609826:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 45 00000100:00100000:3.0:1787381623.609836:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+26:14436:x1874205047121280:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787381623.609868:0:14171:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381623.609892:0:14171:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10f88 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953c13 expref: -99 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381623.609925:0:14171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea10f8f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381623.609938:0:14171:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea10f8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381623.609949:0:14171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea10f8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381623.610063:0:14171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10f88 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953c13 expref: 28 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381623.610081:0:14171:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0600/0xbdc38ada7ea10f8f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953c13 expref: 27 pid: 14171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381623.610089:0:14171:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a1643052d00) 00010000:00010000:3.0:1787381623.610092:0:14171:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787381623.610095:0:14171:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb0600, rc 0) 00000100:00100000:3.0:1787381623.610158:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+27:14436:x1874205047121280:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 323us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381623.610164:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 45 00000100:00100000:0.0:1787381623.615162:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381623.615588:0:15953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047121536 00000100:00100000:3.0:1787381623.615598:0:15953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047121536 00000100:00100000:3.0:1787381623.615657:0:15953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00100000:3.0:1787381623.615667:0:15953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+27:14436:x1874205047121536:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787381623.615763:0:15953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0e00/0xbdc38ada7ea10f96 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381623.615780:0:15953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0e00/0xbdc38ada7ea10f96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381623.615793:0:15953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0e00/0xbdc38ada7ea10f96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787381623.616240:0:15953:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1787381623.616252:0:15953:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 481747246361ns, next at 482747244201ns, rc = 0 00000004:00010000:3.0:1787381623.616604:0:15953:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000429aa505 reply state 000000005b086746 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0e00/0xbdc38ada7ea10f96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381623.616615:0:15953:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787381623.616759:0:15953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+29:14436:x1874205047121536:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 1091us (1604us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1787381623.616768:0:15953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00100000:0.0:1787381623.624310:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381623.624436:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047121664 00000100:00100000:3.0:1787381623.624447:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047121664 00000100:00100000:3.0:1787381623.624504:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:3.0:1787381623.624514:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+29:14436:x1874205047121664:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787381623.624540:0:14172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381623.624561:0:14172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea10f9d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953c1a expref: -99 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381623.624617:0:14172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea10f9d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953c1a expref: 30 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381623.624648:0:14172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea10f9d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953c1a expref: 30 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381623.624667:0:14172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a1643052d00) 00010000:00010000:3.0:1787381623.624670:0:14172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787381623.624674:0:14172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb1c00, rc 0) 00000100:00100000:3.0:1787381623.624730:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+30:14436:x1874205047121664:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 217us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381623.624737:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:2.0:1787381623.628853:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381623.628972:0:15543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047121792 00000100:00100000:3.0:1787381623.628982:0:15543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047121792 00000100:00100000:3.0:1787381623.629072:0:15543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:3.0:1787381623.629082:0:15543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+5:2349:x1874205047121792:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1787381623.629391:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787381623.629756:0:15543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a800e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+6:2349:x1874205047121792:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 Request processed in 673us (909us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787381623.629765:0:15543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 10 00010000:00010000:1.0:1787381623.630208:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0e00/0xbdc38ada7ea10f96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.630221:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0e00/0xbdc38ada7ea10f96 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.630228:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0e00/0xbdc38ada7ea10f96 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.630234:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1647eb0e00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381623.630239:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0e00/0xbdc38ada7ea10f96 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.630247:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0e00/0xbdc38ada7ea10f96 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.630263:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a1643052d00) 00010000:00010000:1.0:1787381623.630266:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787381623.630271:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0e00/0xbdc38ada7ea10f96 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.630277:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0e00/0xbdc38ada7ea10f96 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381623.633447:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381623.633509:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047122048 00000100:00100000:3.0:1787381623.633518:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047122048 00000100:00100000:3.0:1787381623.633918:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:3.0:1787381623.633930:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+29:14436:x1874205047122048:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787381623.634930:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+30:14436:x1874205047122048:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 999us (1488us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1787381623.634941:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:2.0:1787381623.638464:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381623.638547:0:15953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047122304 00000100:00100000:3.0:1787381623.638568:0:15953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047122304 00000100:00100000:3.0:1787381623.638621:0:15953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 48 00000100:00100000:3.0:1787381623.638630:0:15953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+30:14436:x1874205047122304:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787381623.638748:0:15953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a800700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+30:14436:x1874205047122304:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 118us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381623.638755:0:15953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 48 00000100:00100000:2.0:1787381623.643754:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381623.650197:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047122432 00000100:00100000:3.0:1787381623.650214:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047122432 00000100:00100000:3.0:1787381623.650306:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 49 00000100:00100000:3.0:1787381623.650317:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a803100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+30:14436:x1874205047122432:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787381623.650339:0:14172:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381623.650361:0:14172:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10fa4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953c21 expref: -99 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381623.650434:0:14172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0e00/0xbdc38ada7ea10fab lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381623.650448:0:14172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0e00/0xbdc38ada7ea10fab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381623.650460:0:14172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0e00/0xbdc38ada7ea10fab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787381623.650500:0:14172:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787381623.650518:0:14172:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0e00/0xbdc38ada7ea10fab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14172 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381623.650544:0:14172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1200/0xbdc38ada7ea10fa4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953c21 expref: 32 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381623.650582:0:14172:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0e00/0xbdc38ada7ea10fab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953c21 expref: 31 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381623.650590:0:14172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a1643052d00) 00010000:00010000:3.0:1787381623.650593:0:14172:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787381623.650597:0:14172:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb0e00, rc 0) 00000100:00100000:3.0:1787381623.650672:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a803100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+31:14436:x1874205047122432:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 357us (6927us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381623.650680:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 49 00000100:00100000:1.0:1787381623.661678:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381623.661788:0:14807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047122560 00000100:00100000:3.0:1787381623.661807:0:14807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047122560 00000100:00100000:3.0:1787381623.661917:0:14807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:3.0:1787381623.661929:0:14807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f560000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+6:2349:x1874205047122560:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787381623.661946:0:14807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787381623.661968:0:14807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009aa01595/0xbdc38ada7ea10fb2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc01952459a953c28 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787381623.661995:0:14807:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a894776, blocks: 0x1 00010000:00010000:3.0:1787381623.662044:0:14807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=481s v=(0 0) 00010000:00010000:3.0:1787381623.662050:0:14807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787381623.662060:0:14807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009aa01595/0xbdc38ada7ea10fb2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953c28 expref: 7 pid: 14807 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381623.662076:0:14807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009aa01595/0xbdc38ada7ea10fb2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953c28 expref: 7 pid: 14807 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381623.662108:0:14807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a1647eb1200, rc 0) 00000100:00100000:3.0:1787381623.662171:0:14807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f560000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+7:2349:x1874205047122560:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 245us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381623.662179:0:14807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:0.0:1787381623.667830:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381623.667999:0:15953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047122816 00000100:00100000:3.0:1787381623.668041:0:15953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047122816 00000100:00100000:3.0:1787381623.668090:0:15953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 50 00000100:00100000:3.0:1787381623.668101:0:15953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+31:14436:x1874205047122816:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787381623.668221:0:15953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+31:14436:x1874205047122816:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 121us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381623.668229:0:15953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 50 00000100:00100000:0.0:1787381623.675788:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381623.675876:0:14172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047122944 00000100:00100000:3.0:1787381623.675886:0:14172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047122944 00000100:00100000:3.0:1787381623.675956:0:14172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 51 00000100:00100000:3.0:1787381623.675967:0:14172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+31:14436:x1874205047122944:12345-192.168.203.22@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787381623.744236:0:14172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+31:14436:x1874205047122944:12345-192.168.203.22@tcp:44:lhsmtool_posix.0 Request processed in 68262us (68447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381623.744249:0:14172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 51 00000001:00080000:2.0:1787381623.744833:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934611 is committed 00000001:00080000:2.0:1787381623.744872:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:2.0:1787381623.744898:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:2.0:1787381623.744907:0:5813:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1787381623.744913:0:5813:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:2.0:1787381623.745226:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787381623.745243:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16600ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065977088:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787381623.745400:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381623.748674:0:14808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065977088 00000100:00100000:3.0:1787381623.748689:0:14808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065977088 00000100:00100000:3.0:1787381623.748818:0:14808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787381623.748828:0:14808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065977088:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787381623.749113:0:14808:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787381623.749117:0:14808:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1787381623.749119:0:14808:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787381623.749121:0:14808:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787381622 -> 1787381622 00002000:00010000:3.0:1787381623.749124:0:14808:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787381623.749231:0:14808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a802680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1874205065977088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 403us (3830us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1787381623.749238:0:14808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:3.0:1787381623.749294:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a16600ea680/2, rc 0, transno 8589934595 00000100:00100000:3.0:1787381623.749312:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16600ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065977088:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787381623.749567:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381623.749724:0:14805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047123072 00000100:00100000:3.0:1787381623.749730:0:14805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047123072 00000100:00100000:3.0:1787381623.749770:0:14805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:3.0:1787381623.749778:0:14805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f560e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+7:2350:x1874205047123072:12345-192.168.203.22@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787381623.749928:0:14805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f560e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+7:2350:x1874205047123072:12345-192.168.203.22@tcp:16:lhsmtool_posix.0 Request processed in 151us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381623.749936:0:14805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00080000:2.0:1787381623.749994:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787381623.757552:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381623.758000:0:15953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047123328 00000100:00100000:0.0:1787381623.758052:0:15953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047123328 00000100:00100000:0.0:1787381623.758112:0:15953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 52 00000100:00100000:0.0:1787381623.758122:0:15953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+14:14436:x1874205047123328:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787381623.758199:0:15953:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787381623.758225:0:15953:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb0e00/0xbdc38ada7ea10fab lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953c21 expref: 14 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.758244:0:15953:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a1643052d00) 00010000:00010000:0.0:1787381623.758248:0:15953:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787381623.758277:0:15953:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8000/0xbdc38ada7ea10fb9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.758290:0:15953:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8000/0xbdc38ada7ea10fb9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.758299:0:15953:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8000/0xbdc38ada7ea10fb9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787381623.758488:0:15953:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000ee2e472 reply state 000000007751057c transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8000/0xbdc38ada7ea10fb9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381623.758497:0:15953:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787381623.758589:0:15953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+15:14436:x1874205047123328:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 469us (1046us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1787381623.758597:0:15953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 52 00010000:00010000:1.0:1787381623.760435:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8000/0xbdc38ada7ea10fb9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.760450:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8000/0xbdc38ada7ea10fb9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.760458:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8000/0xbdc38ada7ea10fb9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.760464:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1645bc8000 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:1.0:1787381623.760469:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8000/0xbdc38ada7ea10fb9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.760476:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8000/0xbdc38ada7ea10fb9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.760492:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a1643052d00) 00010000:00010000:1.0:1787381623.760495:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787381623.760499:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8000/0xbdc38ada7ea10fb9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.760506:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc8000/0xbdc38ada7ea10fb9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15953 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381623.762565:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381623.762929:0:14808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047123456 00000100:00100000:0.0:1787381623.762939:0:14808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047123456 00000100:00100000:0.0:1787381623.763036:0:14808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:0.0:1787381623.763047:0:14808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+7:2350:x1874205047123456:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787381623.763505:0:14808:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787381623.763509:0:14808:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787381621 00002000:00010000:2.0:1787381623.763512:0:14808:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787381621 00002000:00010000:2.0:1787381623.763514:0:14808:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787381622 -> 1787381621 00002000:00010000:2.0:1787381623.763516:0:14808:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787381623.763584:0:14808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+8:2350:x1874205047123456:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 Request processed in 538us (1026us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787381623.763593:0:14808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:3.0:1787381623.766263:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381623.766342:0:14807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047123584 00000100:00100000:0.0:1787381623.766352:0:14807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047123584 00000100:00100000:0.0:1787381623.766404:0:14807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:0.0:1787381623.766428:0:14807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+8:2349:x1874205047123584:12345-192.168.203.22@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787381623.766471:0:14807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c23f0d40/0xbdc38ada7ea10fc0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.766487:0:14807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381623.766492:0:14807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381623.766499:0:14807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c23f0d40/0xbdc38ada7ea10fc0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.766512:0:14807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c23f0d40/0xbdc38ada7ea10fc0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.766542:0:14807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c23f0d40/0xbdc38ada7ea10fc0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.766550:0:14807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c23f0d40/0xbdc38ada7ea10fc0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.766557:0:14807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c23f0d40/0xbdc38ada7ea10fc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.766563:0:14807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1645bc9e00 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:0.0:1787381623.766567:0:14807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c23f0d40/0xbdc38ada7ea10fc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.766576:0:14807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c23f0d40/0xbdc38ada7ea10fc0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.766599:0:14807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c23f0d40/0xbdc38ada7ea10fc0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.766607:0:14807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c23f0d40/0xbdc38ada7ea10fc0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381623.766690:0:14807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+8:2349:x1874205047123584:12345-192.168.203.22@tcp:1:lhsmtool_posix.0 Request processed in 263us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381623.766698:0:14807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:1.0:1787381623.776592:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381623.776785:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047123840 00000100:00100000:2.0:1787381623.776794:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047123840 00000100:00100000:2.0:1787381623.776885:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 53 00000100:00100000:2.0:1787381623.776894:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a6cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+14:14436:x1874205047123840:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787381623.776980:0:14173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166ae00/0xbdc38ada7ea10fc7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.776997:0:14173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166ae00/0xbdc38ada7ea10fc7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.777030:0:14173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166ae00/0xbdc38ada7ea10fc7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.777283:0:14173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166a400/0xbdc38ada7ea10fce lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.777301:0:14173:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea10f9d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953c1a expref: 15 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.777308:0:14173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166a400/0xbdc38ada7ea10fce lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.777341:0:14173:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea10f9d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953c1a expref: 15 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.777355:0:14173:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea10f9d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953c1a expref: 15 pid: 14172 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381623.777369:0:14173:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a800a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14173:1874205065977216:192.168.203.22@tcp:104: 00000100:00100000:2.0:1787381623.777515:0:14173:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1658263b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787381623.781593:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381623.781698:0:14173:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a800a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14173:1874205065977216:192.168.203.22@tcp:104: 00010000:00010000:2.0:1787381623.781727:0:14173:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166a400/0xbdc38ada7ea10fce lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381623.781804:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047123968 00000100:00100000:0.0:1787381623.781811:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047123968 00010000:00010000:0.0:1787381623.781848:0:14157:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea10f9d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953c1a expref: 16 pid: 14172 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381623.781885:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:0.0:1787381623.781894:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542860e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+16:2349:x1874205047123968:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787381623.781911:0:14157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787381623.781918:0:14157:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea10f9d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953c1a expref: 16 pid: 14172 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.781931:0:14157:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea10f9d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953c1a expref: 16 pid: 14172 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.781951:0:14157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1c00/0xbdc38ada7ea10f9d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953c1a expref: 16 pid: 14172 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.781987:0:14157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a1643052d00) 00010000:00010000:0.0:1787381623.781992:0:14157:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166a400/0xbdc38ada7ea10fce lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.782001:0:14157:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166a400/0xbdc38ada7ea10fce lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.782052:0:14157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166a400/0xbdc38ada7ea10fce lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381623.782078:0:14157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787381623.782140:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542860e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+15:2349:x1874205047123968:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 247us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381623.782148:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 13 00010000:00010000:2.0:1787381623.782304:0:14173:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166a400/0xbdc38ada7ea10fce lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.782312:0:14173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166a400/0xbdc38ada7ea10fce lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787381623.782497:0:14173:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1787381623.782641:0:14173:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1787381623.782687:0:14173:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1787381623.782763:0:14173:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a800a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14173:1874205065977344:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787381623.782863:0:14173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381623.782896:0:14173:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a167a372180 going to sleep for 11 seconds 00000100:00100000:0.0:1787381623.783530:0:14176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065977344 00000100:00100000:0.0:1787381623.783539:0:14176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065977344 00000100:00100000:0.0:1787381623.783583:0:14176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787381623.783592:0:14176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a803b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14173:x1874205065977344:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787381623.783676:0:14176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a803b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14173:x1874205065977344:12345-0@lo:1000:mdt00_002.0 Request processed in 85us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381623.783684:0:14176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787381623.783754:0:14173:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a800a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14173:1874205065977344:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787381623.784439:0:14173:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1787381623.784511:0:14173:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a800a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14173:1874205065977472:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787381623.784552:0:14173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787381623.784574:0:14173:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1647478240 going to sleep for 11 seconds 00000100:00100000:0.0:1787381623.785711:0:14176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065977472 00000100:00100000:0.0:1787381623.785722:0:14176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065977472 00000100:00100000:0.0:1787381623.785761:0:14176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787381623.785770:0:14176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14173:x1874205065977472:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787381623.785997:0:14176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a800000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14173:x1874205065977472:12345-0@lo:1000:mdt00_002.0 Request processed in 227us (1444us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787381623.786036:0:14176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787381623.786337:0:14173:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a800a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14173:1874205065977472:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1787381623.786375:0:14173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166a400/0xbdc38ada7ea10fce lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.786386:0:14173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166a400/0xbdc38ada7ea10fce lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.786394:0:14173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166a400/0xbdc38ada7ea10fce lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.786399:0:14173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a164166a400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381623.786403:0:14173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166a400/0xbdc38ada7ea10fce lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.786411:0:14173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166a400/0xbdc38ada7ea10fce lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.786426:0:14173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a1643052d00) 00010000:00010000:2.0:1787381623.786429:0:14173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787381623.786434:0:14173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166a400/0xbdc38ada7ea10fce lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.786441:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166a400/0xbdc38ada7ea10fce lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.786482:0:14173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9800/0xbdc38ada7ea10f2d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.786489:0:14173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9800/0xbdc38ada7ea10f2d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.786494:0:14173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9800/0xbdc38ada7ea10f2d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.786499:0:14173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1645bc9800 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381623.786502:0:14173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9800/0xbdc38ada7ea10f2d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.786508:0:14173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9800/0xbdc38ada7ea10f2d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.786517:0:14173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a16522d1000) 00010000:00010000:2.0:1787381623.786520:0:14173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787381623.786527:0:14173:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea10f34 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953bfe expref: 18 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.786537:0:14173:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea10f34 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953bfe expref: 18 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.786545:0:14173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea10f34 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953bfe expref: 18 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.786600:0:14173:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a1647eb1400/0xbdc38ada7ea10f34 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953bfe expref: 18 pid: 14172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381623.786626:0:14173:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a802a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14173:1874205065977600:192.168.203.22@tcp:105: 00000100:00100000:2.0:1787381623.786701:0:14173:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1647478840 going to sleep for 11 seconds 00000100:00100000:1.0:1787381623.791594:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381623.791673:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047124096 00000100:00100000:3.0:1787381623.791682:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047124096 00000100:00100000:3.0:1787381623.791742:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:3.0:1787381623.791753:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a166f69f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+19:14435:x1874205047124096:12345-192.168.203.22@tcp:49:dd.0 00000100:00100000:3.0:1787381623.791884:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a166f69f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+19:14435:x1874205047124096:12345-192.168.203.22@tcp:49:dd.0 Request processed in 134us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381623.791890:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:2.0:1787381623.792239:0:14173:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a802a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14173:1874205065977600:192.168.203.22@tcp:105: 00010000:00010000:2.0:1787381623.792264:0:14173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9800/0xbdc38ada7ea10f2d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.792274:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1645bc9800/0xbdc38ada7ea10f2d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14171 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.792302:0:14173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166a400/0xbdc38ada7ea10fd5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.792314:0:14173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166a400/0xbdc38ada7ea10fd5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.792336:0:14173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166a400/0xbdc38ada7ea10fd5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.792344:0:14173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166a400/0xbdc38ada7ea10fd5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.792350:0:14173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166a400/0xbdc38ada7ea10fd5 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.792356:0:14173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166a400/0xbdc38ada7ea10fd5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.792362:0:14173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a164166a400 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381623.792365:0:14173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166a400/0xbdc38ada7ea10fd5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.792385:0:14173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166a400/0xbdc38ada7ea10fd5 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.792400:0:14173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a16522d1000) 00010000:00010000:2.0:1787381623.792402:0:14173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787381623.792406:0:14173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166a400/0xbdc38ada7ea10fd5 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.792422:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166a400/0xbdc38ada7ea10fd5 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.792433:0:14173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166ae00/0xbdc38ada7ea10fc7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.792439:0:14173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166ae00/0xbdc38ada7ea10fc7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.792445:0:14173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166ae00/0xbdc38ada7ea10fc7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.792450:0:14173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a164166ae00 already unused, calling callback (ffffffffc21e64f0) 00010000:00010000:2.0:1787381623.792452:0:14173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166ae00/0xbdc38ada7ea10fc7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.792458:0:14173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166ae00/0xbdc38ada7ea10fc7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.792466:0:14173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9a16522d1000) 00010000:00010000:2.0:1787381623.792468:0:14173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787381623.792471:0:14173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166ae00/0xbdc38ada7ea10fc7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381623.792492:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a164166ae00/0xbdc38ada7ea10fc7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381623.792842:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a6cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+18:14436:x1874205047123840:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 15947us (16259us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1787381623.792852:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 53 00000020:00080000:2.0:1787381623.792857:0:14173:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1787381623.793306:0:14205:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787381623.793311:0:14205:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787381623.793340:0:14205:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787381623.793346:0:14205:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787381623.796394:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381623.796508:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047124352 00000100:00100000:3.0:1787381623.796518:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047124352 00000100:00100000:3.0:1787381623.796577:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:3.0:1787381623.796588:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542860380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+18:14436:x1874205047124352:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787381623.797504:0:14174:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787381623.797632:0:14174:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1787381623.797679:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1640030000/0xbdc38ada7ea10fdc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381623.797695:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a1640030000/0xbdc38ada7ea10fdc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381623.797707:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a1640030000/0xbdc38ada7ea10fdc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381623.797715:0:14174:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1640030000/0xbdc38ada7ea10fdc lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381623.797721:0:14174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a1640030000/0xbdc38ada7ea10fdc lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381623.797726:0:14174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a1640030000/0xbdc38ada7ea10fdc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381623.797744:0:14174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787381623.797840:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542860380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+20:14436:x1874205047124352:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 1251us (1452us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1787381623.797850:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 11 00000020:00080000:3.0:1787381623.797855:0:14174:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787381623.798019:0:14159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787381623.798025:0:14159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a1640030000/0xbdc38ada7ea10fdc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.798033:0:14159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1640030000 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:1.0:1787381623.798038:0:14159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1640030000/0xbdc38ada7ea10fdc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.798045:0:14159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a1640030000/0xbdc38ada7ea10fdc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.798058:0:14159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9a1643052d00) 00010000:00010000:1.0:1787381623.798061:0:14159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787381623.798066:0:14159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a1640030000/0xbdc38ada7ea10fdc lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.798072:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a1640030000/0xbdc38ada7ea10fdc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381623.798084:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381623.798086:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787381623.798088:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787381624.011684:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381624.011742:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381624.011880:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047124480 00000100:00100000:3.0:1787381624.011898:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047124480 00000100:00100000:3.0:1787381624.012048:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047124608 00000100:00100000:3.0:1787381624.012054:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047124608 00000100:00100000:2.0:1787381624.012083:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:2.0:1787381624.012102:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+9:2351:x1874205047124480:12345-192.168.203.22@tcp:4:dd.0 00010000:00010000:2.0:1787381624.012152:0:14812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fde134c/0xbdc38ada7ea10fe3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381624.012172:0:14812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009aa01595/0xbdc38ada7ea10fb2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc01952459a953c28 expref: 9 pid: 14807 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381624.012180:0:14812:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787381624.012185:0:14812:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787381624.012189:0:14812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fde134c/0xbdc38ada7ea10fe3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381624.012221:0:14812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009aa01595/0xbdc38ada7ea10fb2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953c28 expref: 9 pid: 14807 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381624.012236:0:14812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009aa01595/0xbdc38ada7ea10fb2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953c28 expref: 9 pid: 14807 timeout: 582 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381624.012267:0:14812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a802a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:14812:1874205065977728:192.168.203.22@tcp:104: 00000100:00100000:2.0:1787381624.012367:0:14812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9a1647478840 going to sleep for 11 seconds 00000100:00100000:2.0:1787381624.023665:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381624.023716:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381624.023751:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381624.023781:0:14813:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787381624.023813:0:14813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1787381624.023826:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381624.023993:0:14813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047124736 00000100:00100000:0.0:1787381624.024030:0:14813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047124736 00000100:00100000:0.0:1787381624.024085:0:14813:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787381624.024104:0:14813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047124864 00000100:00100000:0.0:1787381624.024108:0:14813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047124864 00000100:00100000:0.0:1787381624.024132:0:14813:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787381624.024137:0:14813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047124992 00000100:00100000:0.0:1787381624.024140:0:14813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047124992 00000100:00100000:1.0:1787381624.024338:0:16190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047125248 00000100:00100000:1.0:1787381624.024343:0:16190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047125248 00010000:00010000:1.0:1787381624.024371:0:16190:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009aa01595/0xbdc38ada7ea10fb2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953c28 expref: 13 pid: 14807 timeout: 582 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381624.024404:0:16190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:1.0:1787381624.024421:0:16190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a801880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+13:2350:x1874205047125248:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787381624.024434:0:16190:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787381624.024457:0:16190:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009aa01595/0xbdc38ada7ea10fb2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953c28 expref: 13 pid: 14807 timeout: 582 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381624.024472:0:16190:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009aa01595/0xbdc38ada7ea10fb2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953c28 expref: 13 pid: 14807 timeout: 582 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381624.024499:0:16190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787381624.024504:0:16190:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787381624.024511:0:16190:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001fde134c/0xbdc38ada7ea10fe3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381624.024520:0:16190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fde134c/0xbdc38ada7ea10fe3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381624.024538:0:16190:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787381624.024599:0:16190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a801880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+13:2350:x1874205047125248:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 180us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381624.024607:0:16190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 14 00010000:00010000:1.0:1787381624.024671:0:14812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009aa01595/0xbdc38ada7ea10fb2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc01952459a953c28 expref: 12 pid: 14807 timeout: 582 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381624.024684:0:14812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a802a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:14812:1874205065977728:192.168.203.22@tcp:104: 00010000:00010000:1.0:1787381624.024703:0:14812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001fde134c/0xbdc38ada7ea10fe3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381624.024725:0:14812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001fde134c/0xbdc38ada7ea10fe3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381624.024732:0:14812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fde134c/0xbdc38ada7ea10fe3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381624.025463:0:16304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:0.0:1787381624.025473:0:16304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+11:2351:x1874205047124608:12345-192.168.203.22@tcp:4:dd.0 00010000:00010000:0.0:1787381624.025502:0:16304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9b9c205/0xbdc38ada7ea10fea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381624.025514:0:16304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381624.025518:0:16304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381624.025522:0:16304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9b9c205/0xbdc38ada7ea10fea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381624.025532:0:16304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9b9c205/0xbdc38ada7ea10fea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381624.027059:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381624.027148:0:14813:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1787381624.027160:0:14813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1787381624.027330:0:14813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047125120 00000100:00100000:2.0:1787381624.027342:0:14813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047125120 00000100:00100000:2.0:1787381624.027978:0:16305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:2.0:1787381624.027991:0:16305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+14:2351:x1874205047124736:12345-192.168.203.22@tcp:4:dd.0 00010000:00010000:2.0:1787381624.028071:0:16305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008571c7fc/0xbdc38ada7ea10ff1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381624.028092:0:16305:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787381624.028097:0:16305:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787381624.028107:0:16305:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008571c7fc/0xbdc38ada7ea10ff1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381624.028135:0:16305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008571c7fc/0xbdc38ada7ea10ff1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381624.038593:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1787381624.038655:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381624.038705:0:14813:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1787381624.038715:0:14813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:1.0:1787381624.039596:0:14811:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1787381624.039610:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047125376 00000100:00100000:1.0:1787381624.039619:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047125376 00000100:00100000:1.0:1787381624.039668:0:14811:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1787381624.039673:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047125504 00000100:00100000:1.0:1787381624.039683:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047125504 00000100:00100000:3.0:1787381624.040332:0:16306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 3 00000100:00100000:3.0:1787381624.040346:0:16306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+17:2352:x1874205047124864:12345-192.168.203.22@tcp:4:dd.0 00010000:00010000:3.0:1787381624.040387:0:16306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012722102/0xbdc38ada7ea10ff8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381624.040405:0:16306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787381624.040409:0:16306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787381624.040416:0:16306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012722102/0xbdc38ada7ea10ff8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381624.040430:0:16306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012722102/0xbdc38ada7ea10ff8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787381624.126623:0:7481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:0.0:1787381624.126642:0:7481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:2.0:1787381624.130222:0:16304:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1787381624.130231:0:16304:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787381621 -> 1787381622 00002000:00010000:2.0:1787381624.130234:0:16304:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787381621 -> 1787381622 00002000:00010000:2.0:1787381624.130237:0:16304:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 8199 00010000:00010000:2.0:1787381624.130251:0:16304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9b9c205/0xbdc38ada7ea10fea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381624.130265:0:16304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9b9c205/0xbdc38ada7ea10fea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381624.130274:0:16304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9b9c205/0xbdc38ada7ea10fea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381624.130282:0:16304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1645bc9800 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:2.0:1787381624.130287:0:16304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9b9c205/0xbdc38ada7ea10fea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381624.130296:0:16304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9b9c205/0xbdc38ada7ea10fea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381624.130317:0:16304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9b9c205/0xbdc38ada7ea10fea lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381624.130324:0:16304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9b9c205/0xbdc38ada7ea10fea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381624.130422:0:16304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+21:2351:x1874205047124608:12345-192.168.203.22@tcp:4:dd.0 Request processed in 104945us (118675us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1787381624.130445:0:16304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:2.0:1787381624.130480:0:16304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:2.0:1787381624.130490:0:16304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+20:2351:x1874205047124992:12345-192.168.203.22@tcp:4:dd.0 00010000:00010000:2.0:1787381624.130520:0:16304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c24d3ce/0xbdc38ada7ea10fff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381624.130531:0:16304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787381624.130535:0:16304:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787381624.130541:0:16304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c24d3ce/0xbdc38ada7ea10fff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381624.130552:0:16304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c24d3ce/0xbdc38ada7ea10fff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381624.140258:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787381624.160438:0:16305:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 5242880 00010000:00010000:2.0:1787381624.160580:0:16305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008571c7fc/0xbdc38ada7ea10ff1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381624.160595:0:16305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008571c7fc/0xbdc38ada7ea10ff1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381624.160604:0:16305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008571c7fc/0xbdc38ada7ea10ff1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381624.160621:0:16306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012722102/0xbdc38ada7ea10ff8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381624.160629:0:16306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012722102/0xbdc38ada7ea10ff8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381624.160636:0:16306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012722102/0xbdc38ada7ea10ff8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381624.160641:0:16306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1640030600 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:0.0:1787381624.160646:0:16306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012722102/0xbdc38ada7ea10ff8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381624.160654:0:16306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012722102/0xbdc38ada7ea10ff8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381624.160671:0:16306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012722102/0xbdc38ada7ea10ff8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381624.160678:0:16306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012722102/0xbdc38ada7ea10ff8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381624.160766:0:16306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a802d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+22:2352:x1874205047124864:12345-192.168.203.22@tcp:4:dd.0 Request processed in 120419us (137045us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1787381624.160828:0:16306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 3 00000100:00100000:0.0:1787381624.161093:0:16306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:0.0:1787381624.161105:0:16306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+21:2352:x1874205047125120:12345-192.168.203.22@tcp:4:dd.0 00010000:00010000:0.0:1787381624.161149:0:16306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e8e08cc/0xbdc38ada7ea11006 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381624.161161:0:16306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381624.161166:0:16306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787381624.161172:0:16306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e8e08cc/0xbdc38ada7ea11006 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381624.161183:0:16306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e8e08cc/0xbdc38ada7ea11006 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787381624.161305:0:7481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00010000:00010000:1.0:1787381624.162024:0:14812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fde134c/0xbdc38ada7ea10fe3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381624.162037:0:14812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fde134c/0xbdc38ada7ea10fe3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381624.162044:0:14812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fde134c/0xbdc38ada7ea10fe3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381624.162052:0:14812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a164166ae00 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:1.0:1787381624.162056:0:14812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fde134c/0xbdc38ada7ea10fe3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381624.162065:0:14812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fde134c/0xbdc38ada7ea10fe3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381624.162097:0:14812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fde134c/0xbdc38ada7ea10fe3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381624.162105:0:14812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fde134c/0xbdc38ada7ea10fe3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787381624.162178:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a5c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+15:2351:x1874205047124480:12345-192.168.203.22@tcp:4:dd.0 Request processed in 150081us (150502us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1787381624.162187:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:1.0:1787381624.162213:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:1.0:1787381624.162222:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+14:2352:x1874205047125376:12345-192.168.203.22@tcp:4:dd.0 00010000:00010000:1.0:1787381624.162243:0:14812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb3bd7ee/0xbdc38ada7ea1100d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381624.162254:0:14812:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787381624.162258:0:14812:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787381624.162263:0:14812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb3bd7ee/0xbdc38ada7ea1100d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787381624.162274:0:14812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb3bd7ee/0xbdc38ada7ea1100d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381624.170600:0:16305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a164166a400 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:2.0:1787381624.170614:0:16305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008571c7fc/0xbdc38ada7ea10ff1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381624.170642:0:16305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008571c7fc/0xbdc38ada7ea10ff1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381624.170666:0:16305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008571c7fc/0xbdc38ada7ea10ff1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381624.170676:0:16305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008571c7fc/0xbdc38ada7ea10ff1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381624.170817:0:16305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a803800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+14:2351:x1874205047124736:12345-192.168.203.22@tcp:4:dd.0 Request processed in 142823us (147161us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787381624.170828:0:16305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:2.0:1787381624.173944:0:16305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:2.0:1787381624.173964:0:16305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a802a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+13:2352:x1874205047125504:12345-192.168.203.22@tcp:4:dd.0 00010000:00010000:2.0:1787381624.174018:0:16305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b096119/0xbdc38ada7ea11014 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381624.174036:0:16305:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787381624.174040:0:16305:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787381624.174046:0:16305:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b096119/0xbdc38ada7ea11014 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381624.174059:0:16305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b096119/0xbdc38ada7ea11014 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787381624.225391:0:7481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:0.0:1787381624.225461:0:16304:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 5242880 -> 7654321 00002000:00010000:0.0:1787381624.225466:0:16304:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:0.0:1787381624.225480:0:16304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c24d3ce/0xbdc38ada7ea10fff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381624.225494:0:16304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c24d3ce/0xbdc38ada7ea10fff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381624.225503:0:16304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c24d3ce/0xbdc38ada7ea10fff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381624.225511:0:16304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a164166b000 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:0.0:1787381624.225529:0:16304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c24d3ce/0xbdc38ada7ea10fff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381624.225540:0:16304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c24d3ce/0xbdc38ada7ea10fff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381624.225564:0:16304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c24d3ce/0xbdc38ada7ea10fff lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381624.225571:0:16304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c24d3ce/0xbdc38ada7ea10fff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381624.225658:0:16304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a803480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+17:2351:x1874205047124992:12345-192.168.203.22@tcp:4:dd.0 Request processed in 95166us (201902us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1787381624.225668:0:16304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 4 00000001:00080000:1.0:1787381624.257454:0:7481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00002000:00010000:0.0:1787381624.257559:0:14812:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 16391 00010000:00010000:0.0:1787381624.257576:0:14812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb3bd7ee/0xbdc38ada7ea1100d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381624.257589:0:14812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb3bd7ee/0xbdc38ada7ea1100d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381624.257597:0:14812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb3bd7ee/0xbdc38ada7ea1100d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381624.257604:0:14812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1541388800 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:0.0:1787381624.257609:0:14812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb3bd7ee/0xbdc38ada7ea1100d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381624.257630:0:14812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb3bd7ee/0xbdc38ada7ea1100d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381624.257651:0:14812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb3bd7ee/0xbdc38ada7ea1100d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787381624.257659:0:14812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb3bd7ee/0xbdc38ada7ea1100d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787381624.257752:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a801500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+9:2352:x1874205047125376:12345-192.168.203.22@tcp:4:dd.0 Request processed in 95526us (219164us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787381624.257762:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 6 00010000:00010000:2.0:1787381624.258692:0:16305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b096119/0xbdc38ada7ea11014 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381624.258705:0:16305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b096119/0xbdc38ada7ea11014 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381624.258713:0:16305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b096119/0xbdc38ada7ea11014 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381624.258720:0:16305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a164166ba00 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:2.0:1787381624.258724:0:16305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b096119/0xbdc38ada7ea11014 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381624.258731:0:16305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b096119/0xbdc38ada7ea11014 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381624.258746:0:16305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b096119/0xbdc38ada7ea11014 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787381624.258753:0:16305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b096119/0xbdc38ada7ea11014 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787381624.258821:0:16305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a802a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+7:2352:x1874205047125504:12345-192.168.203.22@tcp:4:dd.0 Request processed in 84862us (220164us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1787381624.258829:0:16305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 7 00010000:00010000:3.0:1787381624.262533:0:16306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e8e08cc/0xbdc38ada7ea11006 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381624.262553:0:16306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e8e08cc/0xbdc38ada7ea11006 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381624.262561:0:16306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e8e08cc/0xbdc38ada7ea11006 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381624.262568:0:16306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a1645bc9200 already unused, calling callback (ffffffffc17aae90) 00010000:00010000:3.0:1787381624.262573:0:16306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e8e08cc/0xbdc38ada7ea11006 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381624.262600:0:16306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e8e08cc/0xbdc38ada7ea11006 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381624.262618:0:16306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e8e08cc/0xbdc38ada7ea11006 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787381624.262625:0:16306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e8e08cc/0xbdc38ada7ea11006 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787381624.262803:0:16306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a800380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+5:2352:x1874205047125120:12345-192.168.203.22@tcp:4:dd.0 Request processed in 101686us (235742us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1787381624.262814:0:16306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 5 00010000:00010000:3.0:1787381625.164533:0:15541:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787381625.915517:0:16345:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1787381626.188484:0:14159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787381626.507804:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381626.507916:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381626.507946:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1787381626.508084:0:15543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047125888 00000100:00100000:3.0:1787381626.508094:0:15543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047125888 00000100:00100000:3.0:1787381626.508169:0:15543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:3.0:1787381626.508180:0:15543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542862d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+5:2349:x1874205047125888:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381626.508262:0:15543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542862d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+5:2349:x1874205047125888:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 83us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381626.508270:0:15543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00080000:3.0:1787381626.508293:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787381626.509190:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381626.509331:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381626.509356:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1787381626.509376:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1787381626.509496:0:15953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047126144 00000100:00100000:0.0:1787381626.509505:0:15953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047126144 00000100:00100000:3.0:1787381626.509611:0:14807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047126400 00000100:00100000:3.0:1787381626.509615:0:14807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047126400 00000100:00100000:3.0:1787381626.509644:0:14807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047126016 00000100:00100000:3.0:1787381626.509648:0:14807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047126016 00000100:00100000:3.0:1787381626.509661:0:14807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047126272 00000100:00100000:3.0:1787381626.509674:0:14807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047126272 00000100:00100000:3.0:1787381626.509695:0:14807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:3.0:1787381626.509703:0:14807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+5:2349:x1874205047126400:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787381626.510130:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047125632 00000100:00100000:2.0:1787381626.510135:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047125632 00000100:00100000:0.0:1787381626.510563:0:15953:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205047125760 00000100:00100000:0.0:1787381626.510568:0:15953:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205047125760 00000100:00100000:1.0:1787381626.510698:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 28 00000100:00100000:1.0:1787381626.510709:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1542861c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+6:2349:x1874205047126144:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1787381626.510799:0:14807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+5:2349:x1874205047126400:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 1095us (2823us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381626.510808:0:14807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:3.0:1787381626.510826:0:14807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:3.0:1787381626.510833:0:14807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+5:2349:x1874205047126016:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1787381626.510884:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 122 00000100:00100000:2.0:1787381626.510891:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16799c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a658e7c5-3f7d-4d71-838f-01592bc16d6a+13:2349:x1874205047125632:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1787381626.510943:0:15953:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 29 00000100:00100000:0.0:1787381626.510951:0:15953:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+20:2349:x1874205047125760:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787381626.511373:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1542861c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+6:2349:x1874205047126144:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 664us (3423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381626.511381:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 28 00000100:00100000:1.0:1787381626.511563:0:14805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:1.0:1787381626.511571:0:14805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+5:2349:x1874205047126272:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1787381626.511610:0:14805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8c893b2d-14df-4f4c-b3bd-3f2d594e7219+5:2349:x1874205047126272:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 40us (2232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381626.511616:0:14805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00080000:1.0:1787381626.511661:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787381626.511666:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787381626.511669:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787381626.512730:0:14807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+5:2349:x1874205047126016:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 1890us (3365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381626.512741:0:14807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:2.0:1787381626.516718:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16799c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a658e7c5-3f7d-4d71-838f-01592bc16d6a+13:2349:x1874205047125632:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 5814us (8912us total) trans 0 rc 0/0 00000100:00100000:2.0:1787381626.516733:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 122 00000100:00100000:0.0:1787381626.517199:0:15953:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce4e36ad-b3a2-4fd4-ac37-f9047c025b36+20:2349:x1874205047125760:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 6246us (7864us total) trans 0 rc 0/0 00000100:00100000:0.0:1787381626.517209:0:15953:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 29 00000100:00100000:3.0:1787381626.701246:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16600e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:3310:1874205065977856:0@lo:400:kworker.0 00000100:00100000:3.0:1787381626.701320:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381626.701363:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16600e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1874205065978368:0@lo:400:kworker.0 00000100:00100000:3.0:1787381626.701388:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381626.701410:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787381626.701417:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16600eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065977984:0@lo:400:kworker.0 00000100:00100000:3.0:1787381626.701441:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381626.701454:0:3310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16600eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1874205065978496:0@lo:400:kworker.0 00000100:00100000:3.0:1787381626.701475:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381626.701501:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16600e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065978112:0@lo:400:kworker.0 00000100:00100000:3.0:1787381626.701522:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381626.701536:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787381626.701542:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a16600ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874205065978240:0@lo:400:kworker.0 00000100:00100000:3.0:1787381626.701578:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381626.701707:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787381626.701716:0:3309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a1674ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065978624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787381626.701744:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787381626.701775:0:14166:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065977856 00000100:00100000:1.0:1787381626.701783:0:14166:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065977856 00000100:00100000:1.0:1787381626.701824:0:14166:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787381626.701833:0:14166:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+19:3310:x1874205065977856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381626.701903:0:14166:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73+19:3310:x1874205065977856:12345-0@lo:400:kworker.0 Request processed in 60us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381626.701911:0:14166:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787381626.701943:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065978368 00000100:00100000:1.0:1787381626.701948:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065978368 00000100:00100000:1.0:1787381626.701989:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065978496 00000100:00100000:1.0:1787381626.701993:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065978496 00000100:00100000:1.0:1787381626.702027:0:14171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065978240 00000100:00100000:1.0:1787381626.702030:0:14171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065978240 00000100:00100000:1.0:1787381626.702043:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787381626.702049:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874205065978368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381626.702080:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874205065978368:12345-0@lo:400:kworker.0 Request processed in 32us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381626.702086:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787381626.702098:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787381626.702103:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f562a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874205065978496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381626.702139:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f562a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874205065978496:12345-0@lo:400:kworker.0 Request processed in 36us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381626.702146:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787381626.702156:0:14171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787381626.702162:0:14171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874205065978240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381626.702186:0:14171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1874205065978240:12345-0@lo:400:kworker.0 Request processed in 24us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381626.702191:0:14171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787381626.702209:0:14805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065977984 00000100:00100000:1.0:1787381626.702212:0:14805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065977984 00000100:00100000:1.0:1787381626.702235:0:14805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065978112 00000100:00100000:1.0:1787381626.702244:0:14805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065978112 00000100:00100000:1.0:1787381626.702268:0:14805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787381626.702274:0:14805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a16600ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065977984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381626.702303:0:14805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a16600ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874205065977984:12345-0@lo:400:kworker.0 Request processed in 30us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381626.702309:0:14805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787381626.702320:0:14805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787381626.702326:0:14805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167f563b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065978112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787381626.702351:0:14805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167f563b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065978112:12345-0@lo:400:kworker.0 Request processed in 26us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381626.702357:0:14805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787381626.702384:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065978624 00000100:00100000:1.0:1787381626.702387:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065978624 00000100:00100000:1.0:1787381626.702411:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787381626.702416:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a1674ed5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065978624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787381626.702439:0:14809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787381626.702469:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a1674ed5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1874205065978624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1787381626.702474:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1787381626.702488:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787381626.702491:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787381626.702493:0:14167:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787381626.702531:0:3309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a1674ed7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1874205065978624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787381626.702559:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16600eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1874205065977984:0@lo:400:kworker.0 00000100:00100000:1.0:1787381626.702568:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16600eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1874205065978496:0@lo:400:kworker.0 00000100:00100000:1.0:1787381626.702577:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16600e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:05783fc6-b3d4-4b64-a7cb-3e5ad5b38b73:3310:1874205065977856:0@lo:400:kworker.0 00000100:00100000:1.0:1787381626.702595:0:3310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16600e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1874205065978368:0@lo:400:kworker.0 00000100:00100000:3.0:1787381626.702874:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16600ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1874205065978240:0@lo:400:kworker.0 00000100:00100000:3.0:1787381626.702884:0:3308:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1787381626.702888:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a16600ea680, transno 8589934595 00000004:00080000:3.0:1787381626.702913:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1787381626.702928:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a16600e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065978112:0@lo:400:kworker.0 00000100:00100000:2.0:1787381626.714177:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787381626.714199:0:3308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9a167a802300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065978752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787381626.714330:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787381626.716087:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874205065978752 00000100:00100000:3.0:1787381626.716102:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874205065978752 00000100:00100000:3.0:1787381626.716198:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787381626.716208:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a167a800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065978752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787381626.716252:0:14809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1787381626.716328:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a167a800a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1874205065978752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (1996us total) trans 0 rc 0/0 00000100:00100000:3.0:1787381626.716335:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787381626.716418:0:3308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9a167a802300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1874205065978752:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787381627.212892:0:14160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29289 lines, 29289 kept, 0 dropped, 0 bad.